(19) 



J 



Europalsches Patentamt 
European Patent Office 
Office europeen des brevets 



(12) 



(ID EP1 111 932A2 

EUROPEAN PATENT APPLICATION 



(43) Date of publication: 


(51) Intel. 7 : H04N7/52, H04N 7/08, 


27.06.2001 Bulletin 2001/26 


H04N 7/26 


(21) Application number: 00310636.6 




(22) Date of filing: 30.1 1 .2000 




(84) DesjgnatecLContracting States: 


♦ Ueda, Mamoru 


AT BE CH CY DE DK ES Fl FR GB GR IE IT LI LU ; 


Shinagawa-ku, Tokyo 141 (JP) 


MC NL PT SETR : 


• Tahara, Katsumr - 


Designated Extension States: 1 ' - J - - 


Shinagawa-ku, Tokyo 141 (JP) 


AL LT LV MK'RO SI 


.." ' *!" ' • 




"(74) Representative::- ." ■ = ... 


(30) "Priority: 03.12:1999 JP 34494099 


Robinson, Nigel Alexander Julian et al 




D.;Young^& Co., . , .. 


(71) Applicant: SONY CORPORATION 


21 New Fetter Lane - 


Tokyo 141 (JP) 


London EC4A 1DA (GB) 


(72) Invent9rs: ; . /w:J .. 




• Kttamura, Takuya 




Shinagawa-ku, Tokyo 141 (JP) 





Information processing apparatus, information processing method and recording medium 



(54) 



(57) Encoding parameters of picture and higher lay- 
ers of importance to a number of applications, and en- 
coding parameters of slice and lower layers of no impor- 
tance to all applications are converted into auxiliary 
packets inserted respectively into a V-blanking area and 
an H-blanking area of a video-data signal output by a 
history-information-multiplexing apparatus employed in 



a video-decoding system. On the other hand, a video- 
encoding system extracts back the auxiliary packets su- 
perposed on the V-blanking area and the H-blanking ar- 
ea from an input base-band video signal. As a result, a 
technique of 'superposing information -on data can be 
changed in accordance with the importance of the infor- 
mation and required information can be fetched with 
ease. 
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Encoding parameters of picture and higher layers of importance to a number 
of applications, and encoding parameters of slice and lower layers of no 
importance to all applications are converted into auxiliary packets inserted 
respectively into a V-blanking area and an H-blanking area of a video-data signal 
output by a history-information-multiplexing apparatus employed in a 
video-decoding system. On the other hand, a video-encoding system extracts 
back the auxiliary packets superposed on the V-blanking area and the H-bianking 
area from an input base-band video signal. A 
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s a result, a technique of superposing information on data can be changed in 
accordance with the importance of the information and required information can 
be fetched with ease. 
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Description 

[0001] The present invention relates to an informa- 
tion-processing apparatus, an information-processing 
method and a recording medium. More particularly, the -'S 
present invention relates' to an information-processing 
apparatus, an information-processing method and a re- 
cording medium of a transcoding system that>allow in- 
formation to be transmitted ih-such a way that necessary 
information ban be extracted from the transmitted infor- 10 
mation with ease in dependences the degree of infor- 
mation importance, and allow information to be read out ' 
from the information-recording medium wherein the pic- 
ture quality does not deteriorate- even -if decoding-and 
encoding processes-are carri eel out repeatedly to modify is 
the structure of an encoded bit ^stream completing ; an 
encoding process 'based on an W PEG (Moving Picture 
Expert Group) standards *.--->• 
[0002]' :i ln recent years, : in a broadcasting station for 
producing and broadcasting television programs, an 20 
MP EG technology is gerierally^adopted to carry out 
processing to compress and/or ^ eh code video data. In 
particular, the ; M PEG technology is becoming a'de L facto 
standard for recording video data into a random-access 
recording medium material or-a tape ; and transmitting - 25 
video data through a cable or by way of ^satellite.' 
[0003]- f The : following description briefly explains ; typi : 
cal processing carried but at a broadcasting 'station up 
to transmission" of -a "video program produced at the 
broadcasting" station to Worries.- -First -of silvan 'encoder 30 
employed ' in a cam-coder encodes source video data 
and records the encoded data ohto : a' magnetic tape of 
e VTR (Video Tape Recorder). Acam-coder is an appa- 
ratus comprising a video Camera and the vTR/which 
are integrate? tb*fo^ the" ^35" 

encoder employed in the cam-coder • encodes the - 
source video* "data into- codes with a recording 'format 
suitable for the magnetic tape of- the VTR. For example, 
in a GOP (Group of Pictures) structure of an MPEG bit 
stream recorded' onto the magnetic tape, 1 GOP con- 40 
sists of 2-picture frames. Thus, ah MPEG bit streamis 
a sequence of picture frames'such as I, B, I, B, l,*B and 
so on where notations land B represent picture frames 
with different types. An MPEG bit stream i is recorded on- 
to a magnetic tape at abit rate of 1 8 Mbps. > 45 
[0004] 'Then, edit processing^ carried out at a main ' 
broadcasting station to edit the video bit stream record- 
ed on the*magnetic tape. In order to "carry out the edit 
processing, the GOP structure of the video bit stream 
recorded on the magnetic tape is converted into a GOP so 
structure suitable for the edit" processing. In a GOP 
structure suitable for the edit processing, 1 GOP com- 
prises 1 frame'and all pictures are 'I pictures. This is be- 
cause, in order to carry out the edit processing in frame 
units, the I picture is most suitable since the I picture ss 
has no correlation with other pictures. In an actual edit 
operation, the video bit stream recorded on the magnet- 
ic tape is first decoded, being restored to base-band vid- 



eo data. Then , the base-band video signal is re-encoded 
so as to convert each picture into an I picture. By carry- 
ing out decoding and re-encoding processes in this way, 
it is possible to generate a bit stream having a GOP 
structure suitable for the edit processing. 
[0005] Next, in-order toitransmit an edited -video pro- 
gram obtained as a result of the editing described above 
from the main;broadcasting station to a local broadcast- 
ing station, the GOP structure-and the bit rate of the'bit 
stream of the edited video program are: converted into 
a GOP structure and a bit rate that are suitable fortrans- 
mission processing. =A GOP structure suitable fortrans- 
mission between stations is a f 'GOP structure in which 1 
GOP consists of 15 picture frames such as I, B, B,~'P, B, 
B, P and 'so-on where notation^ P represents a picture 
frame of- a certain type different from the picture frames 
I and B:-Onthe other hand, a desirable value of the bit 
rate suitable for- transmission between stations is at 
least 50 : Mbps. This is ; 'because 5 a dedicated transmis- 
sion line having. a- high transmissiotf'capacity is gener- 
ally used for transmission between stations. To put' ft > 
concretely?the bit stream of the video program obtained 
as a resufrofthe edit processing is first decoded, -being 
restored to base- band video data; ; Then, the base-band 
video data is re-encoded to convert- the-GOP structure • 
and the bit rate of the base-band video data into a GOP 
structure and a'bit rate that are suitable for the trans- 
mission processing. - ' . " 
[0006] ' At a local broadcasting station, edit processing 
is carried out3o : insert commercials unique to the geo- 
graphical area of the local broadcasting station into the 
video program" received from the main broadcasting sta- 
tion. That is to say, much like^theedit processing de- 
scribed above, the -video bit stream received ; f rom^the 
main b rbadcastin g stat io rv is ' 'f irst deco ded ] * being re- 
stored'to base-band video data. Then,' the base-band 
video signal is re-encoded so as to convert each picture 
into an I picture. By carrying out-decoding and encoding 
processes in this way, it is possible to^geherate a bit 
stream having a GOP structure suitable for the edit 
processing.' ' : 1 - : ■• ?< '*■*-'*'- 
[0007] Next, in order to transmit an edited video pro- 
gram obtained as a result of the editing described above 
from the local broadcasting station to homes, the GOP 
structure* and the bit rate of the bit stream of the edited 
video program-areconverted^into a GOP structure and 
a bit rate that are suitable Tor transmission processing. 
A GOP structure suitable for transmission from a local 
broadcasting station to homes is a GOP structure in 
which 1 GOP consists of 15 picture frames such as I, B, 
B, P, B, B, P and so on. On the other hand, a desirable 
value of-the bit rate suitable for transmission from a local 
broadcasting station to homes is about 5 Mbps. To put 
it concretely, the bit stream of the video program ob- " 
tained as a result of the edit processing is first decoded, 
being restored to base-band video data. Then , the base- 
band video data is re-encoded to convert the GOP struc- 
ture and the bit rate of the base-band video data into a 



3 EP1 111 932A2 4 



GOP structure and a bit rate that are suitable for the 
transmission processing. 

[0008] As is obvious from the above description, dur- 
ing transmission of a video program from the main 
broadcasting station to homes, decoding and encoding 
processes are carried out repeatedly a plurality of times. 
In actuality, processing carried out at a broadcasting sta- 
tion includes various kinds of necessary signal process- 
ing other than the signal processing described above 
and, for each signal processing, decoding and encoding 
processes must be performed. 
[0009] Unfortunately, however, encoding and decod- 
ing processes based on the MPEG standard are not 
100% reversible processes as is generally known. That 
is to say, video data obtained as a result of a decoding 
process is not 1 00% the same as base-band video data 
prior to an encoding process. To be more specific, the 
picture quality deteriorates due to the encoding and de- 
coding processes. To put it in detail, when the encoding 
and decoding processes are carried out repeatedly as 
described above, there is raised a problem that the pic- 
ture quality inevitably deteriorates each time a process 
is performed, in other words, each time the decoding 
and/or encoding processes are repeated, the picture 
quality deteriorates cumulatively. 
[0010] In order to solve this problem, there has been 
proposed a technique for preventing the picture quality 
from deteriorating by transmission of an encoding his- 
tory of transmitted video data along with the video data 
and execution of encoding and decoding processes by 
using the encoding history. 

[0011] In the execution of the decoding and encoding 
processes, however, a transcoding system may not re- 
quire all parameters in some cases in dependence on 
the application to process pictures. Since an area in 
which required data is located is not known, neverthe- 
less, it is necessary to design such hardware that all da- 
ta is accessible to the transcoding system. For this rea- 
son, the hardware becomes unavoidably complicated 
and, as a result, the information-processing apparatus 
inevitably becomes large in scale. In addition, if a packet 
is lost due to an effect of a noise, restoration of data 
including and following the lost packet becomes difficult 
so that it is feared that much data is unavoidably lost. 
[001 2] It is thus an object of at least preferred embod- 
iments of the present invention addressing the problems 
described above to provide an information -processing 
apparatus, an information-processing method and a re- 
cording medium that allow information to be transmitted 
in such a way that necessary information can be extract- 
ed from the transmitted information with ease by modi- 
fying a technique to superpose data in dependence on 
the degree of data importance and by recording the data 
at predetermined locations such as a vertical blanking 
area and a horizontal blanking area, and allow informa- 
tion to be read out from the information-recording medi- 
um in a transcoding system wherein the picture quality 
does not deteriorate even if decoding and encoding 



processes are carried out repeatedly to modify the GOP 
structure of an encoded bit stream completing an en- 
coding process based on the MPEG standard. 
[0013] According to a first aspect of the present inven- 
s tion, there is provided an information-processing appa- 
ratus for decoding an input encoded stream and gener- 
ating an output signal, the information-processing appa- 
ratus including extraction means for extracting auxiliary 
data from the input encoded stream, separation means 
for splitting the auxiliary data extracted by the extraction 
means into first auxiliary data and second auxiliary data, 
conversion means for converting the first auxiliary data 
and the second auxiliary data, which were separated by 
the separation means, into data having a predetermined 
format, and insertion means for inserting the first auxil- 
iary data and the second auxiliary data, which were con- 
verted by the conversion means, into a first position and 
a second position of the output signal respectively 
[0014] According to a second aspect of the present 
invention, there is provided an information-processing 
method adopted by an Information-processing appara- 
tus for decoding an input encoded stream and generat- 
ing an output signal, the information-processing method 
including an extraction step of extracting auxiliary data 
from the input encoded stream, a separation step of 
splitting the auxiliary data extracted at the extraction 
step into first auxiliary data and second auxiliary data, 
a conversion step of converting the first auxiliary data 
and the second auxiliary data, which were separated at 
the separation step, into data having a predetermined 
format, and an insertion step of inserting the first auxil- 
iary data and the second auxiliary data, which were con- 
verted at the conversion step, into a first position and a 
second position of the output signal respectively. 
[0015] According to a third aspect of the present in- 
vention, there is provided a recording medium employed 
in an information-processing apparatus for decoding an 
input encoded stream and generating an output signal, 
the recording medium used for recording a program ex- 
ecutable by a computer to implement a method includ- 
ing an extraction step of extracting auxiliary data from 
the input encoded stream, a separation step of splitting 
the auxiliary data extracted at the extraction step into 
first auxiliary data and second auxiliary data, a conver- 
sion step of converting the first auxiliary data and the 
second auxiliary data, which were separated at the sep- 
aration step, into data having a predetermined format, 
and an insertion step of inserting the first auxiliary data 
and the second auxiliary data, which were converted at 
the conversion step, into a first position and a second 
position of the output signal respectively. 
[0016] In the information-processing apparatus, the 
information-processing method and the recording me- 
dium, it is possible to generate and output data from 
which required information can be fetched with ease on 
a reception side. 

[001 7] According to a fourth aspect of the present in- 
vention, there is provided an information-processing ap- 
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paratus for-encoding an inputsignal and generating an 
output-signal, the information-processing apparatus in- 
cluding extraction means for extracting first auxiliary da- 
ta or second auxiliary data, which were inserted into -a 
first position or a second position oHhe input signal re- s 
spectively, selection means for selecting either the first - : 
auxiliary data or the second auxiliary data, whichwere 
extracted by the extraction means, and encoding means 
for encoding the input signal by utilizing the first auxiliary 
data or trie-second auxiliary data, which were selected 10 
by the selection means. ,v *' ^ 

[0018] 'According to a fifth aspect of the present inven- 
tion, there is-provided an information-processing meth- 
od adopted in an' information-processing apparatus for 
encoding an input signal and generating an outputsig- is 
nal, the information -processing method including ah ex-" * 
traction step'of extracting first 'auxiliary data or second 
auxiliary ; data, which : were inserted into a first position 
or a second position of the^input signal -respectively, a : ; 
selection step of selecting either-the first auxiliary data 20 
orthe second auxiliary data, Which were extracted at the 
extraction. step, andean encoding step of encoding the 
input signal by utilizing'the first 7 auxiliary ; data or the sec- • 
ond auxiliary data, which were selected at the selection 
step. ■ ■ ■ .v-*- 25 

[0019] "According fo a^sixth' aspect of the present in- 
vention', there is provided a recording medium "employed 
i n an i nf 0 rmatio n *p rocessi n "g apparatus for en codi h g 'an ' 
input signal and generating an ou^ut sigrial, the record- 
ing medium used for recording! program' executableby 30 
a computer to implement a method includingah extrac- 
tion step of extracting first auxiliary data or second aux- 
iliary data, which were inserted into a first position or a' 
second posftion'Of the input signal Vespectivefy.'a'selec- ' r 
tion stejTof selecting either the fiWauxi Nary "data ohhe*' 35 * 
second auxiliary data, which were extracted at the ex- 
traction step, and an encoding step of encoding the input 
signaHby utilizing the first -auxiliary data or the^second 
auxiliary data; which were selected at theselection step; 
[0020] " i!: ln the information-processing apparatus, the 40 
information-processing method and r the recording me- 
dium, it is possible to fetch only necessary'lnformatibn 
with easVfrom theiriput signal and use the information 
in an encoding process. 

[0021] According" tb'a seventh* aspect of the present ' 7 45 
invention" there is provided an information-processing 
apparatus ' for generating a second encoded stream 
from a first input encoded stream and outputting the sec- 
ond encoded stream, the information-processing'appa- 
ratus including decoding means for decoding the first so 
input encoded stream, and generation'means for encod- 
ing the 'first encoded stream decoded by the-decoding 
means to generate the second encoded stream, where- 
in the decoding means has first extraction means for ex- 
tracting auxiliary data from the first input encoded ss 
stream, separation means for splitting the auxiliary data 
extracted by the first extraction means into first auxiliary 
data and second auxiliary data, conversion means for 



converting the first auxiliary data andthe second auxil- 
iary data, which were separated by the separation 
means, into data having a predetermined format, and 
insertion means for inserting the first auxiliary data and 
the second auxiliary data, which were converted by the 
conversion means, respectively into a' first positioned 
a second position of the first encoded 'Stream decoded 
by the decoding means, the decoding means decodes 
the first encoded stream by using the auxiliary data ex- 
tracted by the first extraction means, the generation 
meanshas second 'extraction means for extracting the 
first auxiliary data or the second -auxiliary data respec- 
tively from the first position orthe second posrtionof the 
first encoded stream decoded by the decoding means, 
and selection means for selecting either the .first auxil- 
iary data- or the second 'auxiliary- data; which-were ex- 
tracted ; by the second extraction means.and the gener- 
ation means encodes the first-encoded stream decoded 
and supplied thereto by the decoding means by . using 
the first auxiliary data or the second auxiliary data, which 
was selected b'y the selection^ means, to' generate the 
second encoded stream. 

[0022]' According-to an eighth -aspect^of the present 
invention/ 5 there is provided an information-processing 
method adopted by an information-processing appara- 
tus for generating a second encoded streamfrom a first 
input en coded 'Stream and outputting the second encod- 
ed stream/the'information-processing method including 
a decoding step of decoding the firstMnput encoded 
stream, and a : generation step of encoding*: the first' en- 
coded stream decoded at the decoding step'to generate 
the second encoded stream, wherein the decoding step 1 
has a first extraction sub-step of extracting auxiliary data 
from the'»first inpuf ; encoded^stream, a ^separation sub- 
step of splitting tHe auxiliary data extracted aTthe "first " 
extraction sub"-step* into -first auxiliary- data and second 
auxiliary-data, Vconversion sub-step'of converting the 
first auxiliary data and the second auxiliary data, which ■ 
were separated at the separation sub-step, ^into data * 
having a predetermined format, -and =an insertion sub- 
step of inserting the first 5 auxiliary data and the second 
auxiliary data] which were converted at the conversion 
sub-step,- respectively into a first position and a second ' 
position of the first encoded stream decoded at the de- 
coding step, the decoding step is executed to decode 
the first encoded stream by using the auxiliary data<ex- 
tracted at the first extraction sub-step, the generation 
step has a second extraction sub-step of extracting the 
first auxiliary data or the second auxiliary data respec- 
tively from the first position or the second position of the 
first encoded stream decoded at the decoding step, and 
a selection sub-step of selecting ertherthe first auxiliary 
data or the second auxiliary data, which was extracted 
at the second extraction sub-step, and the generation 
step is executed to encode the first encoded stream de- 
coded and supplied thereto at the decoding step by us- 
ing the first auxiliary data or the second auxiliary data, 
which was selected at the selection sub-step, to gener- 
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ate the second encoded stream. 
[0023] According to a ninth aspect of the present in- 
vention, there is provided a recording medium employed 
in an information-processing apparatus for generating 
a second encoded stream from a first input encoded 
stream and outputting the second encoded stream, the 
recording medium used for recording a program execut- 
able by a computer to implement a method including a 
decoding step of decoding the first input encoded 
stream, and a generation step of encoding the first en- 
coded stream decoded at the decoding step to generate 
the second encoded stream, wherein the decoding step 
has a first extraction sub-step of extracting auxiliary data 
from the first input encoded stream, a separation sub- 
step of splitting the auxiliary data extracted at the first 
extraction sub-step into first auxiliary data and second 
auxiliary data, a conversion sub-step of converting the 
first auxiliary data and the second auxiliary data, which 
were separated at the separation sub-step, into data 
having a predetermined format, and an insertion sub- 
step of Inserting the first auxiliary data and the second 
auxiliary data, which were converted at the conversion 
sub-step, respectively into a first position and a second 
position of the first encoded stream decoded at the de- 
coding step, the decoding step is executed to decode 
the first encoded stream by using the auxiliary data ex- 
tracted at the first extraction sub-step, the generation 
step has a second extraction sub-step of extracting the 
first auxiliary data or the second auxiliary data respec- 
tively from the first position or the second position of the 
first encoded stream decoded at the decoding step, and 
a selection sub-step of selecting either the first auxiliary 
data or the second auxiliary data, which was extracted 
at the second extraction sub-step, and the generation 
step is executed to encode the first encoded stream de- 
coded and supplied thereto at the decoding step by us- 
ing the first auxiliary data or the second auxiliary data, 
which was selected at the selection sub-step, to gener- 
ate the second encoded stream. 
[0024] In the information-processing apparatus, the 
information-processing method and the recording me- 
dium, it is possible to fetch only necessary information 
with ease from the input signal and use the information 
in an encoding process. 

[0025] According to a tenth aspect of the present in- 
vention, there is provided a decoding apparatus for de- 
coding an encoded source stream, the decoding appa- 
ratus including decoding means for decoding the encod- 
ed source stream in order to generate a base-band vid- 
eo signal by using encoding parameters included in the 
encoded source stream, vertical insertion means for in- 
serting much required ones among the encoding param- 
eters into a vertical -blanking period of the base-band 
video signal, and horizontal insertion means for insert- 
ing little required ones among the encoding parameters 
into a horizontal-blanking period of the base-band video 
signal. 

[0026] According to an eleventh aspect of the present 



invention, there is provided a decoding method adopted 
by a decoding apparatus for decoding an encoded 
source stream, the decoding method including the steps 
of decoding the encoded source stream in order to gen- 
5 erate a base-band video signal by using encoding pa- 
rameters included in the encoded source stream, insert- 
ing much required ones among the encoding parame- 
ters into a vertical-blanking period of the base-band vid- 
eo signal, and inserting little required ones among the 
10 encoding parameters into a horizontal-blanking period 
of the base-band video signal. 
[0027] According to a twelfth aspect of the present in- 
vention, there is provided a decoding apparatus for de- 
coding an encoded source stream, the decoding appa- 
15 ratus including decoding means for decoding the encod- 
ed source stream in order to generate a base-band vid- 
eo signal by using encoding parameters included in the 
encoded source stream, vertical Insertion means for in- 
serting those of picture and higher layers among the en- 

20 coding parameters into a vertical-blanking period of the 
base-band video signal, and horizontal Insertion means 
for inserting those of slice and lower layers among the 
encoding parameters into a horizontal-blanking period 
of the base-band video signal. 

25 [0028] According to a th irteenth aspect of the present 
invention, there is provided a decoding method adopted 
by a decoding apparatus for decoding an encoded 
source stream, the decoding method including the steps 
of decoding the encoded source stream in order to gen- 

30 erate a base-band video signal by using encoding pa- 
rameters included in the encoded source stream, insert- 
ing those of picture and higher layers among the encod- 
ing parameters into a vertical-blanking period of the 
base-band video signal, and inserting those of slice and 

35 lower layers among the encoding parameters into a hor- 
izontal-blanking period of the base-band video signal. 
[0029] According to a fourteenth aspect of the present 
invention, there is a decoding apparatus for decoding 
an encoded source stream, the decoding apparatus in- 

40 eluding decoding means for decoding the encoded 
source stream in order to generate a base-band video 
signal by using encoding parameters included in the en- 
coded source stream, vertical insertion means for insert- 
ing general ones among the encoding parameters into 

45 a vertical-blanking period of the base-band video signal, 
and horizontal insertion means for inserting detailed 
ones among the encoding parameters into a horizontal- 
blanking period of the base-band video signal. 
[0030] According to a fifteenth aspect of the present 

50 invention, there is provided a decoding method adopted 
by a decoding apparatus for decoding an encoded 
source stream, the decoding method including the steps 
of decoding the encoded source stream in order to gen- 
erate a base-band video signal by using encoding pa- 
ss rameters included in the encoded source stream, insert- 
ing general ones among the encoding parameters into 
a vertical-blanking period of the base-band video signal, 
and inserting detailed ones among the encoding param- 
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eters into a horizontal-blanking period of the base-band 
video signal. 

[0031] According to a sixteenth aspect of the present 
invention, there is provided an encoding apparatus for 
encoding a base-band video signal, the encoding appa- 5 
ratus including extraction means for extractingmuch re- 
quired encoding parameters from a vertical blanking pe- 
riod of the base-band video signal and little required en- 
coding parameters from *a horizontal blanking period of 
the base-band video signal, and re-encoding means for 10 
re-encoding the base-band video signal by referring to 
the much required 'encoding parameters and the little 
required encoding parameters. 1 - 
[0032] According to a seventeenth aspect of the 
present invention, there is provided anencoding method is 
adopted in an. encoding apparatus forencoding.a base- 
band video signal, the encoding method includingihe 
steps of extracting much required encoding parameters 
from a : vertical blanking* period of the base-band video 
signal and littleTequired 'encoding' parameters from a 20 
horizontal blanking period of the base-band video sig- 
nal, and re : encoding the baseband video signal by re- 
ferring to the much required encoding parameters -and 
the little required encoding parameters. " 
[0033] According to an "eighteenth aspect of the 25 
present Invention, there is provided an encoding appa- 
ratus for encoding a^base-bancl video signal; the encod- 
ing apparatus including extraction means r f or extracting' 
encoding parameters of picture andhigher layers from 
a vertical blanking period of the base-band video signal 30 
and encoding parameters of slice and lower layers from 
a horizontal blanking period of the* base-band video ' sig- 
nal, and re-encodirig means for re-encoding the base- 
band video signal : by referring to the encoding parame-^ 
ters of picture alid higher layers and the encoding pa-. ' 35 
rameters of slice and lower layers ? "* 
[0034] ' * According to a "nineteenth aspect of the - tl - 
present invention/there is provided an encoding method 
adopted in an encoding apparatus "for ehcodincfa ibase- * 
band video signaT, the encoding method including the 40 
steps of extracting encoding parameters of picture and 
higher layers from a vertical blanking period of the base- 
band video signal and encoding parameters of slice and 
lower layers from a horizontal blanking period of the 
base-band video signal, and re-encodirig the base-band 45 
video signal by referring to the encoding pararrieters of 
picture and higher layers and the* encoding parameters 
of slice and lower layers. *" ; ' * : 

[0035] According to a twentieth aspect of the present 
invention, there is provided an encoding apparatus for so 
encoding a base-band video signal, the encoding appa- 
ratus including extraction means for extracting general 
encoding parameters from a vertical blanking period of 
the base-band video signal and detailed encoding pa- 
rameters from a horizontal blanking period of the base- 55 
band video signal, and re-encoding means for re-encod- 
ing the base-band video signal by referring to the gen- 
eral encoding parameters and the detailed encoding pa- 



rameters. 

[0036] According to a twenty-first aspect of the 
present invention, there is provided an encoding method 
adopted in an encoding apparatus for encoding a base- 
band video signal, the encoding method including the 
steps of extracting general encoding- parameters from a 
vertical blanking period of the base-band video signal 
and detailed encoding parameters from a horizontal 
blanking period of the base-band video signal, and re- 
encoding the base-band videosignalby referring to the 
general encoding parameters and the detailed encoding 
parameters. 

[0037] Embodiments of the invention willnowbe de- 
scribed, by way of example only, with reference to the 
accompanying drawings in which: 

Fig. 1 is a block diagram showing a configuration of 
a transcoding system provided by one example em- 
bodiment of the present invention; 
Fig. 2 is a block diagram showing a detailed config- 
uration of a video-decoding system employed in the 
transcoding system shown in Fig. 1 ; r - 
Fig. 3 is a block diagram showing a- detailed config- 
uration of a video-encoding system employed in the 
transcoding system shown in Fig/1 ; 
Fig. 4 -is a block' diagram showing another configu- 
rati 0 n of th e transcod i n g system ; 
Fig: 5 is a block diagram showing a : detailed config- 
uration of a decoder embedded in a decoding ap- 
paratus employed in the video-decoding system 
shown in Fig. 2; ; 
Fig. 6 is an explanatory diagram showing pixels of 
a macroblock; 

Fig.' 7 is an explanatory diagram used for describing 
V blanking and H' blanking; 
Figs. : 8A»and 8B are explanatory diagrams used for 
describing the position of start_code; -■-■^ 
Fig. 9 is an explanatory diagram used for describing 
a field structure and a frame structure; 
Fig". 10 is an explanatory diagram used for describ- 
ing the position of startjcode; . 
Fig, 11 is an explanatory diagram used for describ- 
ing an area in which encoding parameters are 
stored; 

Fig. 12 is a block diagram showing a detailed con- 
figuration of an encoder embedded in an encoding 
apparatus employed in the video-encoding system 
shown in- Fig. 3; 

Fig. 13 is a diagram showing a grand system em- 
ploying a plurality of transcoding systems each 
shown in Fig. 4; 

Fig. 14 is a block diagram showing the configuration 
of a tightly coupled transcoding system;" 
Fig. 15 is an explanatory diagram used for describ- 
ing the syntax of the stream of a video sequence; 
Fig. 16 is an explanatory diagram used for describ- 
ing the configuration of the syntax shown in Fig. 15; 
Fig. 17 is an explanatory diagram used for describ- 
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ing the syntax of history_stream ( ) for recording his- 
tory information with a fixed length; 
Fig. 18 is an explanatory diagram used for describ- 
ing the syntax of hlstory_stream ( ) for recording his- 
tory information with a fixed length; 
Fig. 19 is an explanatory diagram used for describ- 
ing the syntax of history.stream ( ) for recording his- 
tory information with a fixed length; 
Fig. 20 is an explanatory diagram used for describ- 
ing the syntax of hlstory.stream ( ) for recording his- 
tory information with a fixed length; 
Fig. 21 is an explanatory diagram used for describ- 
ing the syntax of history_stream ( ) for recording his- 
tory information with a fixed length; 
Fig. 22 is an explanatory diagram used for describ- 
ing the syntax of history_stream ( ) for recording his- 
tory information with a fixed length; 
Fig. 23 is an explanatory diagram used for describ- 
ing the syntax of history_stream ( ) for recording his- 
tory information with a fixed length; 
Fig. 24 is an explanatory diagram used for describ- 
ing the syntax of history.stream ( ) for recording his- 
tory information with a variable length; 
Fig. 25 is an explanatory diagram used for describ- 
ing the syntax of sequence_header ( ); 
Fig. 26 is an explanatory diagram used for describ- 
ing the syntax of sequence_extension ( ); 
Fig. 27 is an explanatory diagram used for describ- 
ing the syntax of extension_and_user_data ( ); 
Fig. 28 is an explanatory diagram used for describ- 
ing the syntax of user_data ( ); 
Fig. 29 is an explanatory diagram used for describ- 
ing the syntax of group_of picture_header ( ); 
Fig. 30 is an explanatory diagram used for describ- 
ing the syntax of picture_heacler ( ); 
Fig. 31 is an explanatory diagram used for describ- 
ing the syntax of picture_coding_extension ( ); 
Fig. 32 is an explanatory diagram used for describ- 
ing the syntax of extension data ( ); 
Fig. 33 is an explanatory diagram used for describ- 
ing the syntax of quant_matrix_extension ( ); 
Fig. 34 is an explanatory diagram used for describ- 
ing the syntax of copyright_extension ( ); 
Fig. 35 is an explanatory diagram used for describ- 
ing the syntax of picture_display_extension ( ); 
Fig. 36 is an explanatory diagram used for describ- 
ing the syntax of picture_data ( ) ; 
Fig. 37 is an explanatory diagram used for describ- 
ing the syntax of slice ( ); 

Fig. 38 is an explanatory diagram used for describ- 
ing the syntax of macroblock ( ); 
Fig. 39 is an explanatory diagram used for describ- 
ing the syntax of macroblock_modes ( ); 
Fig. 40 is an explanatory diagram used for describ- 
ing the syntax of motion_vectors (s); 
Fig. 41 is an explanatory diagram used for describ- 
ing the syntax of motion_vector (r, s) ; 
Fig. 42 is an explanatory diagram used for describ- 
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ing a variable-length code of macroblockjype for 
an (-picture; 

Fig. 43 is an explanatory diagram used for describ- 
ing a variable-length code of macroblockjype for a 
P-picture; 

Fig. 44 is an explanatory diagram used for describ- 
ing a variable-length code of macroblockjype for a 
B-picture; 

Fig. 45 is a block diagram showing a further config- 
uration of the transcoding system; 
Fig. 46 is an explanatory diagram used for describ- 
ing each combination of history-information Items; 
Fig. 47 shows a flowchart representing the opera- 
tion of the transcoding system shown in Fig. 45; 
Fig. 48 is an explanatory diagram used for describ- 
ing the syntax of re_coding„streamJnfo ( ); 
Fig. 49 is an explanatory diagram used for describ- 
ing red_bwjlag and redjDWjndicator; 
Fig. 50 is an explanatory diagram used for describ- 
ing a Re„Coding Information Bus macroblock for- 
mation; 

Fig. 51 is an explanatory diagram used for describ- 
ing picture rate elements; 

Fig. 52 is an explanatory diagram used for describ- 
ing other picture rate elements; 
Fig. 53 is an explanatory diagram used for describ- 
ing further picture rate elements; and 
Fig. 54 is an explanatory diagram used for describ- 
ing an area in which a Re_Coding Information Bus 
is recorded. 



[0038] Preferred embodiments of the present inven- 
tion are described by referring to diagrams as follows. 
[0039] Fig. 1 is a block diagram showing a transcod- 

35 ing system provided by the present invention. A video- 
decoding system 1 receives a bit stream as an input and 
decodes the input signal by adoption of a technique ex- 
plained later by referring to Fig. 5. Then, the video-de- 
coding system 1 writes information, if required, into a V 

40 blanking area and an H blanking area, which will be de- 
scribed later by referring to Fig. 7. Finally, the video-de- 
coding system 1 converts the decoded signal into an 
output base-band video signal. A video-encoding sys- 
tem 2 receives the base-band video signal as an input 

45 and fetches information, if required, from the V blanking 
area and the H blanking area. The video-encoding sys- 
tem 2 then encodes the input signal by adoption of a 
technique explained later by referring to Fig. 12 and fi- 
nally converts the encoded signal into an output bit 

so stream. 

[0040] A VTR 3 serving as a video-processing system 
is used for editing the base-band video signal. 
[0041] Fig. 2 is a block diagram showing a detailed 
configuration of the video-decoding system 1 . 
55 [0042] A decoding apparatus 11 fetches a video sig- 
nal from an input bit stream and outputs the video signal 
to a history-information-multiplexing apparatus 12. The 
decoding apparatus 11 also fetches encoding parame- 
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ters of the immediately preceding generation and sup- 
plies the parameters to the history-information-multi- 
plexing apparatus 12 and a data-classifying apparatus 
1 3. If this transcoding system is a fourth generation, for 
example, encoding parameters of a third generation are 
obtained: In addition, the decoding apparatus 11 outputs 
user data representing a conversion history of previous 
data supplied to 'the video-decoding system 1 to a his- 
tory-decoding apparatus 14. The user data* is thus*en- 
coding parameters of generations preceding the imme- 
diately preceding generation.' 
[0043] The encoding parameters supplied to the data- 
classifying apparatus i 3 are classified into encoding pa- 
rameters of picture and higher layers of importance to 
a number of applications, and encoding parameters of 
slice and lower layers of 'ho importance to all applica- 
tions. The former encoding parameters are supplied to 
a format encocler 15 whereastrie'latter encoding param-- 
eters are output to a format encoder 17. The ^format-en- 
coders 1 5 -and 1 7 convert' the formats of 'the -encoding 
parameters into the format of an auxiliary* packet and 
output results of the conversion to a V-blankihg insertion 
apparatus 16'and^an H blanking insertion apparatus 18 
respectively. ' ' T: 

[0044] The history-decoding apparatus 14 comprises 
a user-data decoder 21* for decoding the user data re- 
ceived'fronvthe decoding apparatus 11 , a converter 22 
for converting the" output of the user-data decoder -21 
and a history VLD (Variable-Length Decoder) 23 for re- 
producing hisTory information from the output of the con- 
verter^.- :r ' ■ ^ , 
[0045] ~ The user-data decoder 21 decodes user data' ' 
supplied by the decoding apparatus 11.; supplying a re- 
sult of the decoding to the converter 22" Details of the 
user data will* be^descTib eSlatef by 1 refe^rring to' Fig : 28 . ' ~ 
At any rate, the user olata* denoted by user jdata'( ) com- 
prises user_datalstart_icdde and userj;dataV According 
to MPEG-specifications, appearance of 23 consecutive 
bits of "0" in usehdata is prohibited in order to prevent 
the data from being ''^detected incorrectly - as 
user_data_start_codel By- the way, history information 
referred to r as'history_stream ( ) may include 23 or more 
consecutive bits of 0 in its user data area, which is a'kind" ' 
of user_data conforming to the MPEG specifications: It 
is thus necessary to' process the history information by 
insertion of a bit "1" into the user data-area with a pre- 
determined timing so that no 23 or more consecutive 
bits of 0 appear in user_data, converting the history in- 
formation into : a ' stream referred to as 
converted_history_stream ( ) to be described later by re- 
ferring to Fig. 15: The component that carries out this 
conversion*' from history_stream () into 
converted_history_stream ( ) is a converter 42 em- 
ployed in a'history-encoding apparatus 38 of the video- 
encoding system 2 of a previous generation shown in 
Fig. 3. On the other hand, the converter 22 employed in 
the history-decoding apparatus 14 carries out a conver- 
sion process to delete the bit"1". This conversion proc- 



ess is opposite to the conversion, which was performed 
by the converter 42 employed in the history-encoding 
apparatus 38 to insert the bit "1" so as to. prevent 23 or 
more consecutive bits of 0 from appearing in the user 
5 data referred to as user_data. 

[0046] The history VLD 23 generates history informa- 
tion from the output of the converter 22 and supplies the 
information to the history-information multiplexing appa- 
ratus 12. In this case, the' history information is.encoding 
10 parameters of -the first and second generations. 

[0047] Toput it in detail, the history-decoding appara- 
tus 14 analyzes the syntax of :the received user data to 
find a unique ID referred to as History_Data_ld de- 
scribed -in the user data. The HistoryjDataJd ID is used 
*s for extracting a ■ stream referred to as 
converted^ istoryjstream ( ). The history-decodin g. ap- 
paratus 14 is capable of further obtaining a stream 're- 
ferred to as history_stream ( ) by removing single mark- - 
er bits 'inserted at- predetermined "intervals -into 
20 c6nverted_history_stream ( ). Then, the historyrdecod- 
ing apparatus 1 4 analyzes the syntax of history_system 
() to obtain the encoding parameters of the first and sec- 
: ond generations/ ■ • ^ v • ■ - * <- 1 ■ - - 
[0048] Assunie that the current processing is' a fourth- 
25 generation change Mn this case, 'data change histories 
received 'by the video-decoding system 1 is.encoding 
parameters of the first, second and third generations, 
and the 'history-information-multiplexing apparatus 12 
multiplexes the encoding parameters of the first, second 
30 and third generations- 1 with the base-band video data 
produced as a result of decoding by the decoding.appa- 
ratus 117The mixed data is to be supplied^to the video- 
encoding system 2 . which will carry-out a fourth-gener- 
ation encoding process. 
"35* [0049] * A' signaToutput by the histdiy-iriforrriation-mu I-" 
tiplexing apparatus '12 is supplied to the V-blanking in- 
sertion apparatus 16 for inserting encoding parameters 
of picture -arid higher layers receivedlfrom the format 
converter T5 into a V-blanking area to be described later 
40 by referring to v Fig. 7. The output of the V-blanking inser- 
tion apparatus 16 is supplied to the H-blanking insertion 
apparatus' 1 8 for inserting encoding parameters of slice 
and lower layers received frortvthe format-converter 17 * 
into an H-blanking area to be described later by referring 
45 to Fig. 7. The output of the H : blankingJnsertion appara : 
tus 1 6 is a base-band video signal supplied to the video- 
encoding system 2. 

[0050] Fig. 3 is a block diagram showing a detailed 
configuration of the video-encoding system 2. * 
50 [0051] An H-blanking extraction apparatus 31 ex- 
tracts an auxiliary packet superposed on an H-blanking 
area from the input base-band video signal and outputs 
the packet to a format converter 32. The format convert- 
er 32 converts the input form at and outputs a packet with 
55 a converted format to a multiplexer 33. By the same to- 
ken, a V-blanking extraction apparatus 34 extracts an 
auxiliary packet superposed on a V-blanking area from 
the input base-band video signal and outputs the packet 
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to a format converter 35, The format converter 35 con- 
verts the input format and outputs a packet with a con- 
verted format to the multiplexer 33. The multiplexer 33 
multiplexes the input signals and outputs a signal ob- 
tained as a result of multiplexing to a parameter-gener- 
ating unit 36. 

[0052] If a packet is missing, the parameter-generat- 
ing unit 36 recovers the lost data by adoption of a tech- 
nique to be described later by referring to Fig. 8, and 
outputs the corrected data to an encoding apparatus 39. 
[0053] After the auxiliary packets have been extracted 
in the H-blanklng extraction apparatus 31 and the V- 
blanking extraction apparatus 34, the data is supplied 
to a history-information-separating apparatus 37, which 
extracts base-band video data from the transmitted da- 
ta. The video data is supplied to the encoding apparatus 
39. The history-information-separating apparatus 37 al- 
so extracts history Information of the first to third gener- 
ations from the transmitted data and supplies the infor- 
mation to the encoding apparatus 39 and a history-en- 
coding apparatus 38. 

[0054] A history VLC (Variable Length Coder) 43 em- 
ployed in the history-encoding apparatus 38 converts 
the format of the encoding parameters of the 3 genera- 
tions, namely, the first, second and third generations, 
received from the history-information-separating appa- 
ratus 37 into a format of history information, which can 
have a fixed length shown in Figs. 17 to 23 to be de- 
scribed later or a variable length shown in Fig. 24 to be 
described later. Details of the fixed-length and variable- 
length formats will be explained later. 
[0055] A converter 42 converts the history information 
with a format obtained as a result of conversion by the 
history VLC 43 into a stream referred to as 
converted_history_stream (). The conversion in the 
converter 42 is carried out in order to prevent data re- 
ferred to as start_code of user_data ( ) from being de- 
tected incorrectly as described earlier. To put it in detail, 
while 23 or more consecutive bits of 0 may appear in 
the history information, appearance of 23 or more con- 
secutive bits of 0 in user_data is prohibited. Thus, the 
converter 42 must converts the history information by 
insertion of "1" with predetermined timings to comply 
with the prohibition. 

[0056] A user-data formatter 41 adds the 
History_DataJd ID to converted_history_stream ( ) re- 
ceived from the converter 42 in accordance with a for- 
mat shown in Fig. 15 to be described later. The user- 
data formatter 41 also adds user_data_stream_code to 
converted_history_stream (). As a result, user_data 
conforming to the MPEG standard is generated. This 
user_data, which can be inserted into a video stream, 
is then supplied to the encoding apparatus 39. 
[0057] The encoding apparatus 39 encodes the base- 
band video data received from the history-information 
separating apparatus 37, converting the data into a bit 
stream having a GOP structure and a bit rate, which are 
specified by an operator or a host computer. It should 



be noted that the structure of a GOP is modified typically 
by changing the number of pictures included in the GOP, 
the number of P pictures existing between 2 consecutive 
I pictures and the number of B pictures existing between 

5 an I picture and a subsequent P or I picture. 

[0058] In this case, since the base-band video data 
received from the history-information separating appa- 
ratus 37 includes history information of the first to third 
generations superposed thereon, the encoding appara- 

10 tus 39 carries out a re-encoding process of a fourth gen- 
eration by selectively reutilizing these pieces of history 
information so as to reduce the amount of deterioration 
of the picture quality caused by the re-encoding proc- 
ess. 

15 [0059] If only data of picture and higher layers is han- 
dled, all the hardware explained earlier by referring to 
Figs. 2 and 3 is not required. That is to say, the format 
converter 1 7 and the H-blanking insertion apparatus 1 8 
can be eliminated from the video-decoding system 1 

20 shown in Fig. 2 whereas the format converter 32 and 
the H-blanking insertion apparatus 31 can be eliminated 
from the video-encoding system 2 shown in Fig. 3. 
[0060] Assume that data of slice and lower layers is 
handled as frequently as data of picture and higher lay- 

25 ers is. In this case, a video-decoding system 51 and a 
video-encoding system 52, which are shown in Fig. 4, 
may be used. As shown in the figure, the video-decoding 
system 51 comprises a decoding apparatus 61 , a histo- 
ry-decoding apparatus 62 and a history-information- 

30 multiplexing apparatus 63 whereas the video-encoding 
system 52 comprises a history-information separating 
apparatus 64, a history-encoding apparatus 65 and an 
encoding apparatus 66. 

[0061] The decoding apparatus 61 fetches a video 
35 signal and encoding parameters from an input bit 
stream, supplying the signal and. the parameters to the 
history-information multiplexing apparatus 63. The de- 
coding apparatus 61 also fetches user data from the in- 
put bit stream, and supplies the data to the history-de- 
40 coding apparatus 62, which decodes the data in the 
same way as the history-decoding apparatus 14. The 
history-decoding apparatus 62 supplies a result of de- 
coding to the history-information multiplexing apparatus 
63. As will be described later by referring to Fig. 7, the 
45 history-information multiplexing apparatus 63 writes the 
encoding parameters into a specified area and supplies 
an output to the history-information-separating appara- 
tus 64. 

[0062] The history-information-separating apparatus 
so 64 extracts base-band video data from data received 
from the history-information multiplexing apparatus 63 
and supplies the video data to the encoding apparatus 
66. The history-information-separating apparatus 64 al- 
so extracts history information of the first, second and 
55 third generations from predetermined locations in the 
data received from the history- information multiplexing 
apparatus 63 and supplies the information to the encod- 
ing apparatus 66 and the history-encoding apparatus 
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65. The history-encoding apparatus 65 carries out the 
same processing as the history-encoding apparatus 38 
to encode the received history information. A result of 
the encoding process is supplied to the encoding appa- 
ratus 66. The encoding apparatus 66 encodes the re- 5 
ceived data, converting the data into a bit stream having 
a predetermined GOP structure and a predetermined bit 
rate. 

[0063]' Fig. 5 'is a block diagram showing a detailed * 
configuration of a decoder B1 employed in the decoding 10 
apparatus 11 explained earlier by referring to Tig. 2 or 
the decoding apparatus 61 explained earlier by referring 
to Fig. 4. : ' — 

[0064] As^shown in-Fig. 5, the decoder 81 comprises 
a reception buffer 91 for bufferings bit stream supplied 15 
to the decoder : 81; : a variable-length decoding" circuit 92 
for carrying out" a variable-length decoding process on 
the encoded 'bit stream, an inverse-quantization circuit 

93 for carrying out an inverse-quantization process on 
data obtained as a result of the variable-length decoding 20 
process' in 'accordance with a quantization scale re- 
ceived from the variable-length-decoding circuits, an 
IDCT (Inverse Discrete Cosine Transformation) circuit 

94 for carrying out an IDCT process on DCT (Discrete * 
Cosine Transformation) 7 coefficients completing the in- 25 
verse-quantizationprocess, a processor 95 for carrying 

out a motion compensation process, a frame memory 
96 and a motion -compensating circuit 97. 
[0065] In order tb decode the encoded bit stream of 
the immediately preceding generation, which is the third 30 
generation in this case, the variable-length decoding cir- 
cuit 92*extracts encoding parameters described in the 
picture layer, the slice layer and the macroblock layer of 
the encoded bit stream. As described earlier by referring 
to Fig. 2, the encoding parameters are supplied also to 35 
the data-classifying apparatus 1 3 for classifying the en- 
coding parameters into encoding parameters of picture 
and higherlayers; and encoding parameters ofsliceand 
lower layers. - : : ; - F 

[0066] For example, encoding parameters of the third 40 
generation extracted by the variable-length decoding 
circuit 92 include picture j:coding_type showing a picture 
type, quantiser_scale_code showing a quantization 
scale step size, macroblock_type showing a prediction 
mode, motion_vecto'r showing a motion vector, frame/ 45 
fie ld_motionltype*sh owing a frame prediction mode or 
a field prediction mode and dct__type showing a 'frame 
DCT mode or a field DCT mode. The quantise r_scale_ 
code parameter is supplied to the inverse-quantization 
circuit 93 whereas the picture_coding_type,' quantiser, so 
scale_code, macroblock_type, motion_vector, frame/ 
field_motion_type, dct_type and other parameters are 
supplied to the motion-compensating circuit 97. 
[0067] The variable-length decoding circuit 92 ex- 
tracts not only the above encoding parameters required 55 
for decoding the encoded bit stream of the third gener- 
ation, but also encoding parameters to'be transferred to 
a transcoding system of the fifth generation at a later 



stage as history information of the third generation from 
a sequence layer, a GOP layer, a picture layer, a slice 
layer and a macroblock layer of the encoded bit stream 
of the third generation. Of course, the encoding param- 
eters of the third generation including the picture^ 
coding_type, quantiser_scale_code, macrobloclOype, 
rnotion_vector, frame/field_motion_type and dct_type 
parameters used in the decoding process of the third 
generation are included in the history information of the 
third generation. The operator or the host computer sets 
information indicating which encoding parameters are 
to be extracted as history information in accordance with 
factors such as ^transmission capacity in advance 1 . 
[0068] In addition, the variable-length decoding circuit 
92 extracts user data described in a user-data area on 
a picture layerofthe encoded bit stream of the third gen- 
eration, and supplies the user data to the history-decod- 
ing system 14. 

[0069] ' As described above, the history- decoding ap- 
paratus 14 is a circuit for extracting encoding parame- 
ters of the first generation and encoding parameters of 
the second generation, which -are described as history 
information, from user-data described on a picture layer 
of the^encoded bit stream of the third generation. The 
encoding parameters of-the first generation and the en- 
coding parameters of the second generation are encod- 
ing parameters of a generation preceding the . immedi- 
ately preceding generation, which is the third generation 
in this case. ■ 
[0070] Moreover, the variable-length decoding circuit 
92 carries out a variable^length decoding process on da- 
ta received from the reception buffer 91 /-and supplies^ 
motion vector, a prediction mode, a prediction flag and 
a DCT ;f lag to the motion-compensating circuit 97, .a 
quantization scale to the inverse-quantization circuit 93 
and decoded picture data to the 'inverse-quantization 
circuit 93/ ' • .* • 

[0071] The inverse-quantization circuit 93 carries out 
an inverse-quantization- process on picture data re- 
ceived from 'the variable- length decoding circuit 92 in " 
accordance with a quantization scale also received from 
the variable-length decoding circuit 92, and supplies da- 
ta obtained as a result of the inverse-quantization proc- 
ess to the IDCT circuit 94. The IDCT circuit 94 carries 
out an inverse discrete cosine transformation process 
on the data, that is, DCT parameters, -received from the 
inverse-quantization circuit 93, and supplies picture da- 
ta obtained as a result of the inverse discrete cosine 
transformation process to the processor 95. 
[0072] If the picture data supplied by the IDCT circuit 

94 to the processor 95 is data of an I picture, the proc- 
essor 95 outputs the data to aforward^prediction picture 
unit 96a of the frame memory 96 to be stored therein. 
The stored data will be used in generation of predicted- 
picture data of picture data supplied later to the proces- 
sor 95. The picture data supplied later to the processor 

95 is data of aP'orB picture. 

[0073] If the picture data supplied by the IDCT circuit 
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94 to the processor 95 is data of a P picture having pic- 
ture data preceding by 1 frame as predicted-picture data 
as well as data of a forward-prediction mode, picture da- 
ta, that Is, data of an I picture preceding by 1 frame is 
read out from the forward-prediction picture unit 96a of 
the frame memory 96 and supplied to the motion-com- 
pensating circuit 97 for carrying out a motion compen- 
sation process corresponding to a motion vector re- 
ceived from the variable-length decoding circuit 92. The 
processor 95 adds picture data, that is, differential data 
received from the IDCT circuit 94, to the output of the 
motion-compensating circuit 97. The result of the addi- 
tion, that Is, data of a decoded P picture, is stored in a 
backward-prediction picture unit 96b of the frame mem- 
ory 96. The stored data will be used in generation of pre- 
dicted-picture data of picture data supplied later to the 
processor 95. The picture data supplied laterto the proc- 
essor 95 is data of a B or P picture. 
[0074] As described above, even in the case of data 
of a P picture, data of an intra-picture prediction mode 
is not subjected to processing carried out by the proc- 
essor 95 but stored in the backward-prediction picture 
unit 96b as it is as is the case with data of an I picture. 
[0075] If the picture data supplied by the IDCT circuit 
94 to the processor 95 is data of a B picture, a prediction 
mode received from the variable-length decoding circuit 
92 is examined. If the prediction mode is a forward-pre- 
diction mode, picture data of an I picture is read out from 
the forward-prediction picture unit 96a of the frame 
memory 96. If the prediction mode is a backward-pre- 
diction mode, picture data of a P picture is read out from 
the backward-prediction picture unit 96b of the frame 
memory 96. If the prediction mode is a forward & back- 
ward-prediction mode, picture data of an I picture is read 
out from the forward-prediction picture unit 96a of the 
frame memory 96 and picture data of a P picture is read 
out from the backward-prediction picture unit 96b of the 
frame memory 96. The motion-compensating circuit 97 
then carries out a motion compensation process for a 
motion vector output by the variable-length decoding cir- 
cuit 92 to generate a predicted picture. In case motion 
compensation is not required or in the case of an intra- 
picture prediction mode, however, no predicted picture 
is generated. 

[0076] The processor 95 adds the data completing the 
motion compensation process in the motion-compen- 
sating circuit 97 as described above to the output of the 
IDCT circuit 94, and outputs a result of the addition. If 
the result of the addition is data of a B picture, however, 
the result of the addition is not stored in the frame mem- 
ory 96 since a B picture is not used in generation of a 
predicted picture for another picture, in addition, the mo- 
tion-compensating circuit 97 also carries out processing 
to restore a structure, wherein signals of lines of odd 
fields are separated from signals of lines of even fields, 
back to the original structure. 

[0077] After the image of the B picture has been out- 
put, data of a P picture stored in the backward-prediction 



picture unit 96b is read out and then supplied to the proc- 
essor 95 by way of the motion-compensating circuit 97. 
It should be noted, however, that no motion compensa- 
tion process is carried out at that time. 

s [0078] Then, outputs from the decoder 81 are sup- 
plied to the history-information-muitiplexing apparatus 
12. To put it concretely, base-band video data output by 
the processor 95 employed in the decoder 81 , encoding 
parameters of the third generation output by the varia- 

10 ble-length decoding circuit 92 employed in the decoder 
81 and encoding parameters of the first and second gen- 
erations output by the history-decoding apparatus 14 
are supplied to the history-information-muitiplexing ap- 
paratus 12, which then multiplexes the encoding param- 

15 eters of the first, second and third generations with the 
base-band video data. As will be explained later by re- 
ferring to Fig. 7, the history-information-multiplexing ap- 
paratus 12 records the encoding parameters into the H- 
blanking and V-blanking areas, generating output data. 

20 [0079] The following description explains a technique 
to multiplex the encoding parameters of the first, second 
and third generations with the base-band video data by 
referring to Figs, 6 to 11, 

[0080] Fig. 6 is a diagram showing a macroblock con- 
25 sisting of 16 pixels x 16 pixels as defined in the MPEG 
specifications. In respect of a luminance signal, the 
macroblock consisting of 16 pixels x 16 pixels is com- 
posed of 4 sub-blocks Y[0], Y[1], Y[2] and Y[3], which 
each consist of 8 pixels x 8 pixels. By the same token, 
30 in respect of a chrominance signal, the macroblock con- 
sisting of 16 pixels x 16 pixels is composed of 4 sub- 
blocks Cr[0], Cr[1] ( Cb[0] and Cb[1], which each consist 
of 8 pixels x 8 pixels. 

[0081] As shown in Fig. 7, the V-blanking insertion ap- 
35 paratus 1 6 inserts encoding parameters of picture and 
higher layers of importance to a number of applications 
typically into a V blanking area. On the other hand, the 
H-blanking insertion apparatus 18 inserts encoding pa- 
rameters of slice and lower layers of no importance to 
40 ali applications typically into a V blanking area. 

[0082] With respectto correction of a defective packet 
in the parameter-reproducing unit 36 described earlier, 
there is a technique whereby previous data is stored in 
advance, and data corresponding to a position in the de- 
45 fective packet is replenished. In this case, if start_code 
is written into the head of each piece of data without 
regard to delimiters of packets as shown in Fig. 8A, all 
pieces of data must be fetched and searched for 
start_code of the data including the defective packet. In 
so order to solve this problem, in the case of information of 
picture and higher layers included in a V blanking area, 
information of 1 macroblock has each start_code always 
written at the head of a packet so as to terminate each 
piece of data on the delimiter of an auxiliary packet of 1 
55 stripe as shown in Fig. 8B. With this scheme, a defective 
packet can be repaired with ease. 
[0083] In a macroblock explained earlier by referring 
to Fig. 6, information of a band unit used as a resolution 
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in the vertical direction is referred to as a stripe. When 
a picture of an interlace format is processed in an 
MPEG2 system, the processing is properly switched 
from a field structure to a frame structure, which are 
shown in Fig. 9, or vice versa. With the field structure, 5 
a picture is processed in field units. With the frame struc- 
ture, on the other hand, a picture is processed in frame 
units, which each consist of 2 fields. For this reason, in 
the field structure, every IS Iines form a stripe. In the 
frame field, on the other hand, every 8 lines form a stripe. 10 
[0084] Encoding parameters of slice and lower layers 
forming thecorresponding stripe are transmitted by us- 
ing the parameters to fill up the H blanking area of the 
stripe. In this way, when the video data of a stripe is re- 
ceivedVthe encoding parameters are obtained at the is 
same time. It is thus no longer necessary to provide a 
mechanism i such as a buffer for adjustment of timings. '-*' 
If start_code exists in a payload of a packet, it is always 
described at the head of the packet as shown in Fig. 10 
in order to-makea packet defect easy 'to repair. "20 
[0085] Fig.' i 1 is a diagram showing a data block used 
for transmitting 1-pixel of the sub-blocks' Y[0]-Y[1], Y[2], 
Y[3], Cr[0], Crfl], Cb[0] and' Cb[T],%hich- each consist 
of 64 pixels. Thus, in order to transmit data of1 macrbb- 
lock, 64 data blocks' eachshowri in Fig .11 are required. 25 
The 2 low-order bits Dt-and DO are used fbf-transmis- 
sion of history iriformatibn. Thus, for video data of "each 
macroblock, 1 ,b24-(64"data blocks x 16 bits/data block) 
bits of history information cari'be transmitted. 256 bits 
of history information are generated for each genera- 30 
tion. Accordingly, history information of 4 024/256) 
preceding generations can be superposed onvideo da-'"* 
ta of 1 macroblock. In the datablockshown in Fig. 11 , "* 
history information of the first, second and th ird. gener- 
ations is superposed. " ~ " * * J 1 r 35 ' 
[0086] Fig. 1 2 is a diagram showing the configuration - 
of an encoder 10lVwhich is -employed in the encoding 
apparatus 39 explain ed earlier' by referring to Fig. 3 or 
the encoding apparatus"66 explained earlier by referring 
to Fig. 4, in : concrete terms. As shown in Fig. 12, the *o 
encoder 101 comprises acontroller 125, amotion-vec- 
tor-detecting circuit 111, a frame memory 1 1 2] a frame/ 
field-prediction : mode-switching circuit 113, a processor 
114, a frame/field-DCT-mode-swftching circuit 115, a 
DCT circuit 116, a quantization circuit 117, a variable- 45 
length encoding circuit itB, a transmission buffer 119, 
an inverse-quantization circuit 1 20, an inverse- DCT (ID- 
CT) circuit 121; a processor 122, a frame-memory 123 
and a motion-compensating circuit 124. 
[0087] The encoder 101 also includes a controller 125 so 
for controlling operations-and functions of the circuits 
enumerated above. The' controller 1 25 receives an in- 
struction with regard to a GOP structure from the oper- 
ator or the host computer, determining the" type of each 
picture so as to comply with the GOP structure. The con- ss 
troller 125 also receives information on a target bit rate 
from the operator or the host computer, controlling the 
quantization circuit 11 7 so that the encoder 1 01 outputs 



data at a bit rate matching the target bit rate specified 
by the operator or the host computer. 
[0088] In addition, the controller 125 also receives his- 
tory information of a plurality of generations from the his- 
tory-information-separating apparatus 37, These pieces 
of history information are used for carrying out a process 
to encode a reference picture. Details are described as 
follows. 

[0089] First of all, the controller 1 25 forms a judgment 
as to whether or not the type of a reference. picture de- 
termined from the GOP structure specif ied-by the oper- 
ator or the host computer matches a picture typeinclud- 
ed in the history information. That is to say, the controller 
1 25 forms a judgment as to whether or not this reference 
picture was encoded in the past with the same picture 
type as the picture type specified by the operator or the 
host computer. To put it in detail, the controller 1 25 forms 
a judgment as to whether or not a picture type.assigned 
to this reference picture in the encodingiprocess-of the 
fourth generation matches the picture type of this refer- 
ence picture in the encoding process otthe first gener- 
ation, the picture type of this reference picture in the en - 
coding process of the second generation or the picture 
type of this reference picture inthe^encoding process of 
the third generation. * vu-r. r / . 

[0090] If the picture type assigned to i this reference 
picture in the encoding process of the fourth generation : 
does not match the picture type of this reference picture 
in the encoding process of the first :generation, the pic- 
ture type of this reference -picture' in the encoding proc- 
ess of the second generation and the picture type of this 
reference picture in the encoding process of : the third 
generation, the controller 125 carries out the normal en- 
coding process. This is because this reference picture 
was not encoded in the encoding process of the'first, ' 
second or third generation with^the same picture type 
as the picture type specified by the operator orthe'host 
computer for encoding process of the fourth generation. ' 
[0091] If the 'pictu re type assign ed :to this reference 
picture-in theencoding process ofthe fourth generation 
matches-trie picturetype of this reference picture in the 
encoding process ofthe first generation, the picturetype 
of this reference picture in the encoding process of the ■ 
second generation or the picture type of this reference 
picture in the encoding process of the third generation; 
on the other hand, the controller^ 25 carries ;out an en- 
coding process reutilizing parameters. This is ^because 
this reference picture was encoded in the encoding 
process of the first, second or third generation with the- 
same picture type as the picture type specified by the 
operator or the host computer for encoding process of 
the fourth generation. ' • .. 

[0092] First of all, the normal encoding process car- 
ried out by the contrbller 125 is explained. 
[0093] Encoded picture data is supplied to the motion- 
vector-detecting circuit 111 in macroblock units. The 
motion-vector-detecting circuit 111 processes picture 
data of each frame as an I, P or B picture in accordance 
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with a predetermined sequence set in advance. That is 
to say, frame pictures sequentially supplied to the mo- 
tion-vector-detecting circuit 111 are to be processed one 
after another as I, P and B pictures indicated by the pre- 
determined sequence set in advance. 
[0094] Picture data of a frame processed as an I pic- 
ture is transferred from the motion-vector-detecting cir- 
cuit 111 to a forward-source picture unit 112a of the 
frame memory 1 1 2 to be stored therein. In the same way, 
picture data of a frame processed as a B picture is trans- 
ferred from the motion-vector-detecting circuit 111 to a 
reference-source picture unit 1 1 2b of the frame memory 
1 1 2 to be stored therein. By the same token, picture data 
of a frame processed as a P picture is transferred from 
the motion-vector-detecting circuit 111 to a backward- 
source picture unit 1 1 2c of the frame memory 1 1 2 to be 
stored therein. 

[0095] At the next timing point a frame to be proc- 
essed as a B or P picture is received, the data of the first 
P picture stored so far in the backward-source picture 
unit 1 1 2c is transferred to the forward-source picture unit 
1 1 2a. At that time, the data of the next B picture is stored 
into the reference-raw picture unit 11 2b overthe existing 
data, or the data of the next P picture is stored into the 
backward-source picture unit 112c over the existing da- 
ta. These operations are carried out repeatedly. 
[0096] The signal of each picture stored in the frame 
memory 112 is read out back, and the frame/field-pre- 
diction-mode-switching circuit 113 carries out process- 
ing in a frame-prediction mode processing or a field-pre- 
diction mode in accordance with an instruction received 
from the controller 125. 

[0097] That is to say, the motion-vector-detecting cir- 
cuit 1 1 1 detects a prediction error in the frame-prediction 
mode and a prediction error in the field-prediction mode, 
supplying values of the prediction errors to the controller 
1 25 to be used in formation of a judgment as to whether 
to select the frame-prediction mode or the field-predic- 
tion mode. The controller 125 then controls the frame/ 
field-prediction-mode-switching circuit 113 so as to op- 
erate in either the frame-prediction mode or the field- 
prediction mode. 

[0098] In addition, the motion-vector-detecting circuit 
1 1 1 also detects prediction errors in the intra-picture pre- 
diction mode, the forward prediction mode, the back- 
ward prediction mode and the forward & backward pre- 
diction mode, supplying the prediction errors to the con- 
troller 1 25 to be used in selection of one of the prediction 
modes. The controller 125 selects the smallest one 
among the prediction errors of the forward prediction 
mode, the backward prediction mode and the forward & 
backward prediction mode as a prediction error of an 
inter-picture prediction mode. The prediction error of an 
inter-picture prediction mode is then compared with the 
prediction error of the intra-picture prediction mode. The 
controller 125 selects the mode for the smaller predic- 
tion error between the prediction error of an inter-picture 
prediction mode and the prediction error of the intra-pic- 
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ture prediction mode as a prediction mode. That is to 
say, If the prediction error of the intra-picture prediction 
mode is smaller, the intra-picture prediction mode is se- 
lected. If the prediction error of the inter-picture predic- 

s tion mode is smaller, on the other hand, the controller 
1 25 sets the forward prediction mode, the backward pre- 
diction mode or the forward & backward prediction 
mode, which corresponds to the smallest one among 
the prediction errors of the forward prediction mode, the 

io backward prediction mode and the forward & backward 
prediction mode, as a prediction mode. 
[0099] The controller 125 then controls the processor 
114 and the motion-compensating circuit 124 so as to 
operate in the selected prediction mode. As a result, da- 

15 ta of an I picture is supplied to the frame/field-DCT- 
mode-switching circuit 115. 

[0100] To put it in detail, the motion-vector-detecting 
circuit 111 finds a prediction error for the intra-picture 
prediction by computing the absolute value of a differ- 

20 ence between HAijl and IIAijl where notation II Aijl is 
the absolute value of a sum of signals Aij , notation II Aijl 
is a sum of the absolute values of signals Aij and nota- 
tion Aij represents a signal of a macroblock of the refer- 
ence picture, in addition, the motion-vector-detecting 

25 circuit 111 finds a prediction error for the forward predic- 
tion by computing IIAij -Bijl where notation IIAij -Bijl is 
a sum of the absolute values of differences Aij -Bij and 
notation Bij represents a signal of a macroblock of a pre- 
dicted picture. The motion -vector-detecting circuit 111 

30 also finds prediction errors for the backward prediction 
and the forward & backward prediction in the same way 
as the forward prediction except that a predicted picture 
different from the predicted picture of the forward direc- 
tion is used. 

35 [0101] The four prediction errors are supplied to the 
controller 1 25 to be compared with each other. The con- 
troller 125 determines the smallest one among the four 
prediction errors, and sets a mode corresponding to the 
smallest prediction error as a prediction mode. To be 
40 more specific, if the prediction error of the intra-picture 
prediction is found to be the smallest one among them, 
the intra-picture prediction mode is set. Otherwise, the 
controller 125 determines the smallest one among the 
remaining three prediction errors for the forward predic- 
ts tion, the backward prediction and the forward & back- 
ward prediction, and sets a prediction mode corre- 
sponding to the smallest prediction error. 
[0102] The frame/field-prediction-mode-switching cir- 
cuit 113 carries out signal processing corresponding to 
so a prediction mode selected by the controller 125, and 
outputs a result of the processing to the processor 114. 
To put it concretely, if a frame prediction mode is select- 
ed, the frame/field-prediction-mode-switching circuit 
1 1 3 carries out signal processing to supply a luminance 
55 signal to the processor 11 4 in the same state as the sig- 
nal was input. As for a chrominance signal, the frame/ 
field-prediction-mode-switching circuit 113 carries out 
signal processing so as to allow odd-field lines coexist 



EP 1 111 932 A2 



55 



13 



25 



EP1 111 932 A2 



26 



with even-field lines. If a field frame prediction mode is 
selected, on the other hand, the frame/field-prediction- 
mode-switching circuit 1 1 3 carries out signal processing 
to compose 2 of the 4 luminance blocks of dots of lines 
of typically odd fields and the remaining 2 luminance 
blocks of dots of linesof even fields.-supplying a result 
of the processing to the processor 114.'Asfor a chromi- 
nance sjgnal, the frame/field-prediction-mode-switching 
circuit -113 carries out signal processing to compose the 
4 upper lines of evemfield lines and the 4 lower lines of 
even-field lines. - jf 
[0103] ln : order to-select a frame DCT modeor a field 
DCT mode, the frame/field-DCT-mode-switching circuit 
115 converts the format of data of the ^' luminance 
blocks intb a signarforrhat of the frame DCTmode and 
a signal format : of the field DCTmode; In the'signal for- 
mat of the frame DCT mode, odd-field lines coexist with 
even-field 'lines.' ! ln' the signal format of the Afield DCT 
mode'; on the other hand, ^odd-field lines are separated 
from even-field lines .The signals of both theTorrnats are 
supplied to the DCT circuit 1 1 6; which computes an en- 
codinglefficiehcy for DCTprocessirig with odd-field lines 
coexisting with even -field! in es'and an encoding efficien- 
cy for DCT processing with' odd^ield' lines separated 
from even-field' lines. The'.DCT circuit 11 '^supplies the 
computed encoding efficiencies to the controller i 25, 
which compares 'the 'encoding efficiencies - with 'each 
other to'select a DCT*rnode f 6f the -better encodihg effi- 
ciency. The controlleM25 then co ntro Is theframe/fiel d- 
DCT-mdde-switching circuit 115 to operate in a DCT 
mode-selected by the controller 125. > ' - 
[01 04] 'Then ,' the frame/f ield^DCT-mode" switch ihg cir- 
cuit 115 outputs data with a configuration conforming to ' 
the selected J DCT f mode to^ the DCT-circuit 116. The 
frame/field-DCT-mode-switching circuit 115 aiso out : * 
puts a ; DCT flag indicating' the selected : DCT mode to 
the variable-length encoding circuit 1 1 8and the motion- 
compensating circuit 124/ ' >; - 
[0105] Asisobvious from the above descriptions, the" 
data structure of theluminance blocks in the field pre- 
diction mode dr the frame prediction mode adopted by 
the frame/field-prediction-mode-switching circuit-113 is 
virtually the sameas the data structure of "the luminance 
blocks of in the field DCT modeor the frame DCT mode 
respectively "adopted by -the 'frame/field-DCT-mode- 
switching circuit 11 57^ 

[0106]- When the frame prediction mode with odd-field 
lines coexisting with even-field lines isselected in the 
frame/field^prediction-mode-switchihg circuit 113, it is 
quite within the bounds of possibility that the frame/field- 
DCT-mode-switching circuit 115 also selects the frame 
DCT mode with odd-field lines coexisting with even-field 
lines. When the field prediction mode with odd-field lines 
separated from' even-field'lines is selected in the frame/ 
field-predictibn-mode-switching circuit 113, on the other 
hand, it is quite within the bounds of possibility that the 
frame/field-DCT-mode-switching circuit 1 1 5 also selects 
the field DCT mode with odd-field lines separated from 



even-field lines. 

[0107] However, the frame prediction mode or the 
' field prediction mode selected by the frame/field^predic- 
tion-mode-switching circuit' 113 does not always coin- 
■ 5 cide respectively with the frame DCT mode or the field 
DCT mode selected by the* frame/field J DCT-mode- 
switching circuit 115 as described above. This is be- 
cause the frame predictionrnode or the field prediction 
mode is selected 'in . the -f rame/field-prediction-mode- 
fo switching circuit 113 to provide a smallest absolute val- 
ue of a prediction' error, while the^frame DCT mode or 
the field DCT mode is selected in the frame/field-DCT- 
mode-switching circuit 1 1 5 to give a better encoding ef- 
ficiency." --4... 
is [0108]- Data j of an I picture produced by the frame/ 
field-DCT-mode-switching circuit 115 is output tothe 
DCT circuit 11 6, which'carries out a DCT process on the 
data tocovert the-data-into DCT coefficients. The DCT 
coefficients are' supplied to the quantization circuit =1*1 7, 
20 which quantizes' the coefficients at a quantization scale 
corresponding to a buffer accurnljlatibn'quantity'repre- 
sentihg'the^amount of dataistored in the transmission 
buffer 1-1 9." The quantized coefficients are'then supplied 
1 to the variables-length encoding circuit 1 1 8/ The quanti- 
'25 zation -scale is determined as follows.. ^ 

[0109] The controller 1 25 j receives a target -bit rate"- 
representing" a desired bit rate from the operatof or the 
host computer and a signal representing the number of 
bits stored in the transmission buffer 119. The signal 
30- representing the number of bits stored in 'the transmis- 
sion buffer 119 is a-signal representirig f the amount of 
data left1n ; the trahsmission : buffer'1f9. The controller 
- 1 25 gene rates a d feedback_q_scale_LCode signar based 
on the target 1 bit -rate and the signal -representing ; the^ 
35 number of bits storied i n the transm ission b uff er"1 1 9 . The 
feedback_iq^scaleicode signaRis a ; contrdl signal used- 
for controlling the size of ^quantization step adopted 
by the quantization circuit 117 in accordance with the - 
amount of data left in the transmission 'buffer 11 9 so that' 
40' neither overflow norunderflow occurs in'the transmis- 
sion buffer 119 and, in addition ;* a bit : stream is output • 
from the : transmission buffer 119 at a bit j rate equal to 
the target bit rate.' "*•""■ ; . ^ ' 

[0110] To put ft concretely, assume for example that 
45 the number of bits stored in the transmission buffer 1 1 9 
becomes too smalls In this case, the size of the quanti- 
zation step is reduced to : increase-the number of bits to 
be generated in a picture encoded next. If the number 
of bits stored in the transmission 'buffer 119 becomes 
so too large, on the other hand, the size-of the quantization 
step is increased to reduce the number of bits'to be gen- 
erated in a picture encoded next. It should be noted that, 
since the feedback_q_scale_code signal is proportional 
to the size of the quantization step, an increase in 
55 feedback_q_scale_code results in an increase in quan- 
tization step size while a decrease in feedback. 
q_scale_code results in a decrease in quantization step 
size. 
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[01 1 1 ] The following description explains a parameter 
reutilization encoding process, which is offered as a 
characteristic of the encoder 101 , by focusing on a dif- 
ference from the normal encoding process described 
earlier. In order to make the parameter reutilization en- 
coding process easy to understand, a reference picture 
is assumed to have been encoded as a P picture In the 
encoding process of the first generation, as an I picture 
in the encoding process of the second generation and 
as a B picture in the encoding process of the third gen- 
eration. In the encoding process of the fourth generation 
carried out this time, the reference picture must be en- 
coded as a P picture. 

[0112] In this case, the reference picture must be en- 
coded in the encoding process of the fourth generation 
as an assigned P picture, which is the same as the pic- 
ture type of the encoding process of the first generation. 
Thus, the controller 125 does not newly creates encod- 
ing parameters from video data supplied thereto. In- 
stead, the controller 125 carries out an encoding proc- 
ess by utilizing the encoding parameters of the first gen- 
eration. Representative encoding parameters reutilized 
in the encoding process of the fourth generation include 
quantiser_scale_code showing a quantization scale 
step size, macroblock_type showing a prediction mode, 
motion_vector showing a motion vector, frame/ 
field_motion_type showing a frame prediction mode or 
a field prediction mode and dct_type showing a frame 
DCT mode or a field DCT mode. 
[0113] In addition, the controller 125 does not reutilize 
all the encoding parameters transmitted as history infor- 
mation. Instead, the controller 1 25 reutilizes only encod- 
ing parameters, the reutilization of which is assumed to 
be desirable. That is to say, encoding parameters, the 
reutilization of which is assumed to be undesirable, are 
not used. Thus, it is necessary to create new values of 
the encoding parameters, the reutilization of which is as- 
sumed to be undesirable. 

[01 14] In the normal encoding process described ear- 
lier, the motion-vector-detecting circuit 111 detects the 
motion vector of the reference picture. In the encoding 
process reutilizing parameters, on the other hand, the 
processing to detect a motion vector (motion_vector) is 
not carried out. Instead, a motion vector (motion_vector) 
received as history information of the first generation is 
reutilized for a reason explained as follows. 
[01 15] The base-band video data obtained as a result 
of a process to decode an encoded stream of the third 
generation has experienced at least 3 decoding proc- 
esses and at least 3 encoding processes. Thus, such 
base-band video data obviously has a deteriorated pic- 
ture quality in comparison with the original video data. 
An accurate motion vector cannot be detected from vid- 
eo data having a deteriorated picture quality even if an 
attempt to detect a motion vector is made. That is to say, 
a motion vector received as history information of the 
first generation obviously has better precision than a 
motion vector detected in the encoding process of the 



fourth generation. In other words, by reutilization of the 
motion vector received as history information of the first 
generation, the encoding process of the fourth genera- 
tion carried out by the controller 125 will not result in a 

5 deteriorated picture quality. The motion vector 
(motion_vector) received as history information of the 
first generation Is supplied to the motion-vector compen- 
sating circuit 124 and the variable-length encoding cir- 
cuit 118 as information on a motion vector of the refer- 

10 ence picture encoded in the encoding process of the 
fourth generation. 

[0116] In addition, in the normal encoding process, 
the motion-vector-detecting circuit 111 detects a predic- 
tion error in the frame-prediction mode and a prediction 

is error in the field-prediction mode, supplying values of 
the prediction errors to the controller 125 to be used in 
formation of a judgment as to whether to select the 
frame-prediction mode or the field-prediction mode. In 
the encoding process by reutilizing parameters, on the 

20 other hand, the motion-vector-detecting circuit 111 does 
not detect a prediction error in the frame-prediction 
mode and a prediction error in the field-prediction mode. 
Instead, the frame/fie I d_motionJype parameter sup- 
plied as history information of the first generation to in- 

25 dicate the frame-prediction mode or the field-prediction 
mode is reutilized. This is because a prediction error of 
the frame-prediction mode and a prediction error of the 
field-prediction mode detected in the processing of the 
first generation respectively have higher precision than 

30 a prediction error of the frame-prediction mode and a 
prediction error of the field-prediction mode detected in 
the processing of the fourth generation. A prediction 
mode selected on the basis of prediction errors having 
higher precision will result in a more optimum encoding 

35 process. 

[0117] To put it concretely, the controller 1 25 supplies 
a control signal corresponding to the frame/ 
field_motion„type parameter received as history infor- 
mation of the first generation to the frame/field-predic- 
40 tion-mode-switching circuit 113, which then carries out 
signal processing corresponding to the reutilized frame/ 
fieid_motion_type parameter. 
[0118] Furthermore, in the normal encoding process, 
the motion-vector-detecting circuit 111 also detects pre- 
45 diction errors in the intra-picture prediction mode, the 
forward prediction mode, the backward prediction mode 
and the forward & backward prediction mode, supplying 
the prediction errors to the controller 1 25 to be used in 
selection of one of the intra-picture prediction mode, the 
so forward prediction mode, the backward prediction mode 
and the forward & backward prediction mode as a pre- 
diction mode, which is also referred to hereafter as a 
prediction direction mode. In the encoding process by 
reutilizing parameters, on the other hand, the motion- 
55 vector-detecting circuit 1 1 1 does not compute prediction 
errors for each of the prediction direction mode. Instead, 
a prediction direction mode is determined on the basis 
of a macroblock_type parameter received as history in- 
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formation of the first generation. This is because predic- 
tion errors of the prediction direction modes detected in 
the processing of the first generation respectively have 
higher precision than prediction' errors of the prediction 
detection modes detected in the processing of the fourth : 5 
generation /A direction prediction mode selected on the 
basis of prediction errors having higher precision will re- 
sult in a more efficient encoding process. To put it con- 
cretely, the controller 125 selects a prediction direction 
mode indicated by the macroblockitype parameter in : *io 
eluded irilhe history information of the first generation,- 
and controls the processor 114 and the motion rcompen- 
sating circuit- 124 to operate in the selected prediction 
direction mode. : " ii -'~ r •' -•■ 

[0119]' In the normal encoding process, irvordertose- 15 
lect a frame DCTmode 6r : a field'DCT moderthe : frame/ ' ■ - 
field-DCT-mode-switching circuit 1 1 5 converts the for- 
mat of data of the 4 luminance blocks into asignal format v 
of the frame DCT modeand assign alTbrniat of the fieid 
DCT mode! The signals of both the formats are supplied - 20 
to the-DCT ; circuif 1 16; -which computes encoding -effi- 
ciencies -of nhe frame DCT mocie-and'the field DCT 
mode, and compares 1 the^computed encoding efficien- 
cies with eacrf other : In* the encoding process reutilizing 
parameters, on the: other hand/ the frame/field.DCT- 25 
mode-switching - circuit '115 does not carry out the 
processing to convert the fbrmat : of- data*6f the 4 lumi- : ~ 
nance'blo'cksTnto b6tha r signal : format r of theframeiDCT* 
mode and -a signal formatof the field DCT mode? In- 
stead , trie frame/field-DCT-mode-switching circuit 115 so 
carries ; o ut 6 n ly process i rig f 0 r a DCT^ mode irid bated 
by thedcPtype pararfieter included in the history infor- 
mation ofthe first generation. To put ; it concretely/the : 
controller 125Teutilizes the a'ctjtype parameter includ- 
ed in ^the"h isto ryl nf 6'rm ation of the lirsfgeneration " a n3 ■ 35 
controls theframe/field-DCT-mbde-switching circuit 115 ' 
to carry out only processing for a DCT mode 'indicated 
by the dctitype parameter included in the history infor- ' 
matioh of the first generation ' ' v J '"■ ? - 1: * "- 
[0120] In the norrrial encoding process, the controller *o 
125 controls f the;quantizati6ri step size of the quantize- ' 
tion circuit^ 17 ok the basis of a target bit rate specified' ' 
by the operator or the host computer and^the amount of 
information'left in the transmission buffer 1 19; In the en- 
coding process reutilizihg -parameters, on "the-other 45 
hand, the quantization step size ofthe quantization cir- 
cuit 117 is controlled on the basis ofthe target bit rate, 
the amount of information -left in thetransmission buffer 
11 9 and a previous quantization scale included in history 
information. It should be noted that, in the following de- so 
scription, the previous quantization scale included in 
history information is called the history_q_scale_code 
parameter. In a history stream to be described later, the 
quantization scale is referred to as quantiser 
scale_code. 55 
[0121]- First of all, the controller 125 generates a cur- 
rent quantization scale referred to as feedback, 
q_scale_code based on the target bit rate and the signal 



representing the number of bits stored in the transmis- 
sion buffer 11 9. The current quantization scale referred 
to as feedback_q_scale_code is a value for controlling 
the quantization step size of the quantization circuit 1 1 7 
in accordance witirthe amount of data left in the trans- 
mission buffer 11 9 so that neither overflow nor underflow 
occurs in the transmission buffer 119. Then, the control- 
ler 125 compares the value of the current quantization 
scale referred to as feedbackiq-scale_icode with -the 
value of a previous quantization -scale referred to^as 
history_q_scale_code included in the 'history-strearn of 
the first generation to form-a -judgment as to whether the 
formeror the larger is greater It should be noted that a 
targe ^quantization scale means a large quantization 
step. Hf'the value of the-current* quantization scale re- 
ferred to' as feedb'ack^q^scale_code ' is found greater 
than the value 'of the' previous quantization 1 scale re- 
ferred tb as"history_q^scale^code, -the' controller 125 
supplies the current quantization 1 scale referred to -as - 
feedback^q_scale_^code to the quantization [ circuit 1.1 7. 
If the value of the current quantization 1 scale Tef erred to 
as feedback_q_scale_^code"is found smaller -than the 
value of the previous quantization 1 scale referred to as 
history_iq_scale_:code*, on the other hand, the controller 
125 supplies theprevi bus ^quantization scale referred to 
as hist6ry_qiscale_code to the quantization circuit 117. 
[0122] -Thatis%sayrthe controlled 25 'selects the 
largest quantization scale code among a pluraiity of pre- ' 
vious quantization scales included in -the 5 history infor- 
mation and the current quantization scale computed 
from the amount of information left inHhe transmission 
buffer 11 9: in other words, -the controller 125 controls 
the quantization circuit 117to*carry out quantization by 
using the largest quantization step among the quantiza- 
tion steps "used in previous en So ding p rocesses, thafis;, 
the encoding processes of the'first, second and third 
generations - and the quantization step used in the cur- :i - 
rent encoding process, -that is, thee ncoding process of 
the fourth generation for a reason described as follows. 
[01 23] Assume that the bit rate of a stream gen erated 
in the encoding process of-the third generation is ^Mbps 
and a targefbifrate Specified for the encoder'1 01 car- 
rying out an encoding process of the'fourth'geheration 
is 15 Mbps. I nth is case, the quantization step is actually 
not reduce'd'Simply because the 1 target bit rate is higher 
than the bit rate of a stream" generated in the immedi- 
ately preceding encoding process; Even if a picture' en- 
coded at a large quantization step in a preceding encod- 
ing process is encoded in the eurrenteri coding process 
at a reduced quantization step, the quality of this picture 
is not improved. That is to say, an encoding process to 
encode a picture-at a quantization step smaller than a 
quantization'step used ina preceding encoding process 
merely increases the n umber of bits bufdoes*not im- 
prove the quality of the picture. Thus, by using the larg- 
est quantization step among the quantization steps 
used in previous encoding processes, that is, the en- 
coding processes of the first, second and third genera- 
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tions, and the quantization step used in the current en- 
coding process, that is, the encoding process of the 
fourth generation, it is possible to carry out an encoding 
process with a highest degree of efficiency. 
[0124] Receiving picture data completing a normal 5 
encoding process or an encoding process reutilizing pa- 
rameters as described above from the quantization cir- 
cuit 117, the variable-length encoding circuit 118 con- 
verts the picture data, which is data of an I picture in this 
case, into a variable-length code such as the Huffman 10 
code in accordance with a quantization scale also re- 
ceived from the quantization circuit 117, and supplies 
the variable-length code to the transmission buffer 119. 
[0125] In addition, the variable-length encoding circuit 
1 1 8 also encodes the quantization scale received from 15 
the quantization circuit 1 1 7, a prediction mode received 
from the controller 125, a motion vector received from 
the motion-vector-detecting circuit 111, a prediction flag 
received from the frame/field-prediction-mode-switch- 
ing circuit 113 and a DCT flag received from the frame/ 20 
field-DCT-mode-switching circuit 115 in a variable- 
length encoding process, As described earlier, the pre- 
diction mode is a mode showing whether the intra-plc- 
ture prediction, the forward prediction, the backward 
prediction or the forward & backward prediction has 25 
been set. The prediction flag is a flag indicating whether 
the frame prediction mode or the field prediction mode 
has been set, and the DCT flag is a flag indicati ng wheth- 
er the frame DCT mode or the field DCT mode has been 
set. 30 
[0126] The transmission buffer 119 is used for tempo- 
rarily storing data supplied thereto and outputs a buffer 
feedback signal to the controller 125, which supplies a 
quantization control signal representing the amount of 
data stored in the buffer 1 1 9 to the quantization circuit 35 
117. When the amount of data left in the transmission 
buffer 119 exceeds an allowable upper limit, the quan- 
tization circuit 117 increases the quantization scale in 
accordance with the quantization control signal received 
from the controller 1 25 in order to decrease the amount 40 
of quantized data. When the amount of data left in the 
transmission buffer 119 reversely goes below an allow- 
able lower limit, on the other hand, the quantization cir- 
cuit 1 1 7 decreases the quantization scale in accordance 
with the quantization control signal received from the *s 
controller 125 in order to increase the amount of quan- 
tized data. As a result, an overflow and an underflow are 
prevented from occurring in the transmission buffer 119. 
[01 27] The data stored in the transmission buffer 1 1 9 
is read out with a predetermined timing as an output. so 
[01 28] On the other hand, the data of the I picture out- 
put by the quantization circuit 11 7 is supplied also to the 
inverse-quantization circuit 120, which then carries out 
an inverse-quantization process at a quantization scale 
received from the quantization circuit 1 1 7. The output of 55 
the inverse-quantization circuit 120 is supplied to an ID- 
CT (Inverse Discrete Cosine Transformation) circuit 
121 , which then carries out an IDCT process thereon. 
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The result of the inverse discrete cosine transformation 
process is supplied to the frame memory 123 by way of 
the processor 122 to be stored in a forward-prediction 
picture unit 123a of the frame memory 123. 
[0129] Assume that the motion-vector-detecting cir- 
cuit 111 processes picture data of frames sequentially 
supplied thereto as pictures having the types of I, B, P, 
B, P, B and so on. In this case, after the picture data of 
the first received frame has been processed as an I pic- 
ture and before the data of the next received frame is 
processed as a B picture, the data of the frame imme- 
diately following the next frame is processed as a P pic- 
ture. This is because, since a B picture necessitates 
backward prediction entailing the following picture, a de- 
coding process cannot be carried out unless the imme- 
diately succeeding P picture to serve as a backward- 
prediction picture is prepared in advance. 
[0130] Thus, after the picture data of the first received 
frame has been processed as an I picture, the motion- 
vector-detecting circuit 111 starts processing of the data 
of the P picture stored in the backward-source picture 
unit 1 12c. Then, in the same way as the one described 
before, the motion- vector-detecting circuit 111 supplies 
a sum of the absolute values of prediction errors or a 
sum of the absolute values of differences between 
frames for macroblocks to the controller 125 for each 
mode. The frame/field-prediction-mode-switching cir- 
cuit 113 operates in the frame prediction mode or the 
field prediction mode in accordance with an instruction 
received from the controller 125. In addition, the proc- 
essor 114 and the motion-compensating circuit 124 op- 
erate in the intra-picture prediction mode, the forward 
prediction mode, the backward prediction mode or the 
forward & backward prediction mode in accordance with 
an instruction issued by the controller 125 as a result of 
comparison of the sums for the modes received from 
the motion-vector-detecting circuit 111 . 
[0131] If the intra-picture prediction mode is selected, 
the processor 114 sets a switch 114d at a contact point 
a. In this case, the data processed by the frame/field- 
prediction-mode-switching circuit 113 is output to a 
transmission line by way of the f rame/field-DCT-mode- 
switching circuit 115, the DCT circuit 116, the quantiza- 
tion circuit 117, the variable-length encoding circuit 118 
and the transmission buffer 11 9 as is the case with an I 
picture. The data is also supplied to the frame memory 
123 by way of the inverse-quantization circuit 120, the 
inverse-DCT (IDCT) circuit 121 and the processor 122 
to be stored in the backward-prediction picture unit 1 23b 
of the frame memory 123. 

[0132] If the forward prediction mode is selected, the 
processor 1 1 4 sets the switch 1 1 4d at a contact point b, 
and the motion-compensating circuit 1 24 reads out data 
stored in the forward-prediction picture unit 1 23a of the 
frame memory 1 23. The data stored in the forward-pre- 
diction picture unit 123a is data of an I picture in this 
case. The motion-compensating circuit 124 compen- 
sates a motion in accordance with a motion vector out- 
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put by the motion-vector-detecting circuit 111 . That is to 
say, requested by the controller 125 to set the forward 
prediction mode, the motion-compensating circuit 124 
reads out data from the forward-prediction picture unit 
123a by shifting the read address from a position corre- 
sponding to a location of a macroblock currently 'being 
output by the motion -vector-detecting circuit 111 'by a 
shift distance corresponding to the motion vector also 
output by the motion -vector-detecting circuit 1 1 1 to gen- 
erate prediction picture data. 

[0133] The prediction picture data generated by the 
motion-compensating circuit 124 is supplied to a proc- 
essor 114a, which then . subtracts the prediction picture 
data received from the motion-compensating circuit 1 24 
for a macroblock of a reference picture received from 
the f rame/field-prediction-m ode-switch ing :i circuit- 113 
from the data-of the macroblock, and outputs thediffer- 
ence as a predictionerror.This prediction error or this 
differential data is output to a transmission line by way 
of the frame/field-DCT-rhode-switching,circuit 115, the 
DCT circuits 16/ the quantization circuit 1 17-, the varia- 
ble-length encoding circuit 118 iand the ! transmission 
buffer 1 1 9. The -differential- data is also locally decoded^ 
by theinveree-quantization ; circuit120 and theinverse- 
DCT (IDCT) circuit 121 before being supplied to the 
processor 122. r - 

[0134] The processor 122 also receives the prediction ■ 
picture data supplied to ; the processor 114a. The proc- 4 
essor 122 adds differential data- output by thelDCT cir- 
cuit 121 tolhe prediction picture data [generated by the 
motion-compensating circuit 124. Asa result, data of the 
original (decoded) P picture is' obtained; The data of the 
original (decoded) Ppicture is supplied to the backward- 
prediction picture uniM23b of the frame memory 123: 
[0135] After me'dataoMhe I and ; P pictures has been 
stored in : the'forward-predictibn and* backward-predic- 
tion pict'ureaihits : 123a and 123b respectively as de- 
scribed above, the motion-vector-detecting circuit 111 
carries out processing'on the B picture. To putit in detail, : 
the motion-vector-detecting circuit 111' supplies a sum 
of the absolute values of prediction errors or a sum of 
the absolute values of differences between frames for 
macroblocks to the controller 125'for each mode. The 
frame/field-predictiohtmode-switching circuit 113 oper- 
ates in the frame prediction mode or the field prediction 
mode in accordance with an instruction received from 
the controller 125. In addition, the processor 114 and 
the motion-compensating circuit 124 operate in the in- 
tra-picture prediction mode; the forward prediction 
mode, the backward prediction mode or the forward & 
backward prediction mode in accordance with an in- 
struction issued by the controller 1 25 as a result of com- 
parison of the sums forthe modes received from the mo- 
tion-vector-detecting circuit 111 . 
[01 36] As described above, if the intra-picture predic- 
tion mode is selected, the processor 11 4 sets the switch 
114d at the contact point a. If the forward prediction 
mode is selected, however, the processor 114 sets the 
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switch 11 4d at the contact point b. At that time, the data 
is transmitted after being processed in the same way as 
a P picture. 

[0137] If the backward or forward & backward predic- 
tion mode is selected, on the other hand, the processor 
114 sets the switch 114d at the contact points or d re- 
spectively. 

[0138] In the backward prediction mode with the 
switch 114d set at the contact point c, data of a picture 
stored in the backward-prediction picture-unit 123b is 
read out by the motion -compensating circuit 124 'and 
subjected to a motion compensation process according 
to a motion vector output by the motion-vector-detecting 
circuit '111 in the motion-compensating circuit 124. In 
this case, the picture stored in the backward-prediction 
picture uriiM23b is a P picture. That is to say, requested 
by the controller 125 --to set the backward prediction 
mode, the motion-compensating circuit 124 reads out 
data from the backward-prediction picture unit 123b by 
shifting the read address^from-a position corresponding 
to a location of a macroblock currently being output by 
the motion-vector-detecting circuit 1H*by-a shift dis- 
tanced rresp on ding to the motion vector also output by * 
the motion -vector-detecting circuit 111 to generate pre- 
diction picture data: 

[0139] The prediction picture data generated by the 
motion-compensating circuit 124 is supplied to a- proc- 
essor^ 4b, which then subtracts theprediction picture 
data received from th&motion-compensating circuit 1 24 
from the data of a macroblock of a- reference picture re- 
ceived from the frame/field-prediction-mode-switching 
circuit 113, and outputs the difference as differential da- 
ta. This differential data is output to the transmission line 
by way v of v the frame/field-DCT-mode-switching circuit 
115, theDCTcirciiit 11 6, the quantizatioh'circuit 1 17, : the 
variable-length encoding circuit 118 and 'the transmis- 
sion buffer 119. 

[0140] In the forward &■ backward prediction mode 
with the switch 114d set* at the- contact point d, data of 
a picture stored in the forward-prediction picture unit 
123a and the data of a picture stored in the. backward- 
prediction picture unit 123b are read out by the motion- 
compensating circuit 124 -and subjected to a motion 
compensation process according to a motionvectdr out- 
put by the'motion-vector-detectirig circuit 11 t in the mo- 
tion-compensating circuit 124; r ln this case, the picture 
storedin the forward-prediction picture unit 123a is. an 
I picture and the picture" stored in the backward-predic- 
tion picture unit 123b is a P picture. 
[0141] That is to say, requested by the controller 125 
to set the forward & backward prediction mode, the mo- 
tion-compensating circuit 124 reads out data from the 
forward-prediction picture unit 123a by shifting the read 
address from a position corresponding to a location of 
a macroblock currently being output by the motion-vec- 
tor-detecting circuit 111 by a shift distance correspond- 
ing to a motion vector also output by the motion-vector- 
detecting circuit 111 forthe forward prediction picture to 
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generate prediction picture data as well as data from the 
backward-prediction picture unit 123b by shifting the 
read address from the position corresponding to the lo- 
cation of the macroblock currently being output by the 
motion-vector-detecting circuit 111 by a shift distance 
corresponding to another motion vector also output by 
the motion-vector-detecting circuit 111 for the backward 
prediction picture to generate other prediction picture 
data. 

[0142] The pieces of prediction picture data generat- 
ed by the motion-compensating circuit 1 24 are supplied 
to a processor 114c, which then subtracts an average 
of the pieces of prediction picture data received from the 
motion-compensating circuit 1 24 from the data of a mac- 
roblock of a reference picture received from the motion- 
vector-detecting circuit 111, and outputs the difference 
as differential data. This differential data is output to the 
transmission line by way of the frame/field-DCT-mode- 
switching circuit 115, the DCT circuit 116, the quantiza- 
tion circuit 1 1 7, the variable-length encoding circuit 1 1 8 
and the transmission buffer 119. 
[0143] Never used as a prediction picture of another 
picture, a B picture is not stored In the frame memory 
123. 

[0144] It should be noted that the forward-prediction 
picture unit 123a and the backward-prediction picture 
unit 1 23b of the frame memory 1 23 can be implemented 
as 2 memory banks. The frame memory 123 can be 
switched from one memory bank to another when nec- 
essary to select a forward-prediction picture or a back- 
ward-prediction picture stored in one of the banks for a 
desired reference picture. 

[01 45] While the above description is focused on a lu- 
minance block, a chrominance block can be processed 
and transmitted in the same way with the macroblock of 
Fig. 6 used as a unit. It should be noted that, as motion 
vectors in the processing of a chrominance block, a ver- 
tical-direction component and a horizontal-direction 
component each having a magnitude equal to 1/2 the 
motion vector of the corresponding luminance block are 
used. 

[0146] Fig. 13 is a diagram showing a grand system 
of typically an image-editing studio comprising a plural- 
ity of transcoding systems connected to each other in 
series. In a history-information multiplexing apparatus 
63-i employed in the video-decoding system 51 -i where 
i = 1 to N, most recent encoding parameters used by the 
history-information multiplexing apparatus 63-i are re- 
corded into a region for storing least recent encoding 
parameters in an area for storing encoding parameters, 
overwriting the least recent parameters. Thus, as ex- 
plained earlier by referring to Fig. 11 , base-band picture 
data includes encoding parameters or generation histo- 
ry information of the 4 most recent generations for the 
same macroblock. 

[0147] In the grand system shown in Fig. 13, the vid- 
eo-decoding system 51 and the video-encoding system 
52 of the transcoding system, which were explained by 



referring to Fig. 4, are employed. It is needless to say, 
however, that in place of the video-decoding system 51 
and the video-encoding system 52, the video-decoding 
system 1 shown in Fig. 2 and the video-encoding system 
s 2 shown in Fig. 3 can also be employed respectively. 
[0148] As described above, in the transcoding system 
implemented by the embodiment, the video-decoding 
system 1 or 51 on the decoding side is loosely coupled 
with the video-encoding system 2 or 52 on the encoding 
10 side, and encoding parameters are multiplexed with pic- 
ture data prior to transmission. It should be noted, how- 
ever, that a decoding apparatus can also be directly con- 
nected to an encoding apparatus by tight coupling as 
shown in Fig. 14. 
is [0149] To put it in detail, a variable-length decoding 
circuit 92 employed in a decoding apparatus 61 extracts 
encoding parameters of the third generation from a se- 
quence layer, a GOP layer, a picture layer, a slice layer 
and a macroblock layer of an encoded stream of the 
20 third generation, supplying the parameters to a history- 
encoding apparatus 65. At the same time, the variable- 
length decoding circuit 92 supplies a base-band video 
signal with the encoding parameters of the picture and 
higher layers inserted into a V-blanking area and the en- 
25 coding parameters of the slice and lower layers inserted 
into an H-blanking area to a controller 1 25 employed in 
an encoding apparatus 66. The history-encoding appa- 
ratus 65 converts the encoding parameters of the third 
generation received from the variable-length decoding 
30 circuit 92 into a stream referred to as converted^ 
history_stream ( ), which can be described in the user 
data area of the picture layer. This stream referred to as 
converted_history_stream ( ) is then supplied to a vari- 
able-length encoding circuit 1 1 8 employed in the encod- 
es jng apparatus 66 as user data. 

[0150] The variable-length decoding circuit 92 also 
extracts user data referred to as user_data including en- 
coding parameters of the first generation and encoding 
parameters of the second generation from the user data 
40 area of the picture layer of the encoded stream pertain- 
ing to the third generation, supplying the user data to 
the history-decoding apparatus 62. The history-decod- 
ing apparatus 62 then extracts the encoding parameters 
of the first generation and the encoding parameters of 
45 the second generation from a history stream described 
in the user data area as converted_history_stream ( ), 
supplying the parameters to the controller 125 em- 
ployed in the encoding apparatus 66. 
[0151] The controller 125 employed in the encoding 
50 apparatus 66 controls an encoding process carried out 
by the encoding apparatus 66 in accordance with the 
encoding parameters of the first generation and the en- 
coding parameters of the second generation, which 
were received from the history-decoding apparatus 62, 
55 as well as encoding parameters, which are recorded in 
the V-blanking and H-blanking areas and were received 
from the decoding apparatus 61 . 
[0152] The variable-length encoding circuit 118 em- 
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ployed in the encoding apparatus 66 receives encoding 
parameters included in input data from the decoding ap- 
paratus'61-and user data including the encoding param- 
eters of the third generation from the history-encoding 
apparatuses. The variable- length encoding circuit 118 5 
records these pieces of user data as history information 
in the user data area of the picture layer of the encoded 
strearn pertaining to the fourth generation before out- 
putting them.- 

[0153] Fig/15 is a diagram showing a syntax used for -io 
decoding an MPEG video stream. A decoder decodes 
an MPEG bit. stream In accordance with this syntax in 
order to-extract a plurality of meaningful data'items or 
meaningful data elements fronrrthe bit stream. In the 
syntax to be "explained below, a function and a condi- is 
tional statement are each represented by a string of nor- ' 
mal characters whereas a data element- is represented 
by a string of bold characters. A data item is described 
by the 'Mnemonic' representing the name of the data'"'" 
item. In- some cases, the Mnemonic also- indicates the 20 
bit length-composing the data item and the-type and the 
transmission order of the data item. 
[0154] -Rrsfof all, functions .used in the syntax shown 
in Fig. 15 are 'explained: 

[0155] A function referred to as next_start_code (') is 25 
a function used fbrsearching abitstreani fora start code - 
described Nn the bit stream. In the syntax shown in Fig. 
15, the next_start_code () function is ' followed by a 
sequence_header( ) function and a sequence_exten- : 
si on ( l ) ''function which are laid out sequentially to indi- 30 
cate that the bit strearn 'includes data elements defined 
by the'sequehce_header> ( ) and'sequence_extension 
( ) functions'Thus, a start code, a kindof-dataelement 
described at the J beginhihg of thesequence3eader ( ) 
and sequencelex^ is' found by the 4 '35' 

next_start_icode ( ) function from the bit stream in an op- 
eration 1 to decode the^bfcstrearn'. The start code is then 
used as a reference to further find the sequeticeiheader 
() and sequehce_extensidh () functions and decode - 
data elements defined by the sequence_header ( ) and 40 
sequencejextensibn (^functions. ' 
[0156] It should be noted that the sequenceiheader 
() function is a function used for defining header data 
of a sequence layer in the- MPEG bit stream whereas 
the sequerice_extension-'( ) function is a function used 
for defining extension data of a sequence layer in the 
MPEG bit stream. - r " 

[0157] A do~{'} while statement is described after the 
sequence_extension ( ) function. The do { } while state- 
ment comprises a { } block following a do statement and 
a while statement following the { } block: Data elements 
described by functions in the'{ } block following the do 
statement are extracted from the data stream as long 
as a condition defined by the while statement is true. ' 
That is tb say, the do { } while statement defines a de- 
coding process to extract data elements described by 
functions in the { } block following the do statement from 
the bit stream as long as the condition defined by the 



while statement is true. 

[0158] Afunction referred to as nextbits ( ) used in the 
while statement is a function used to compare a bit or a 
string of bits- appearing in the bit stream with a data el- 
ement to be decoded next. In the example of the syntax 
shown in Fig. 15, the nextbits ( ) function compares a 
string of bits appearing in the bit stream with 
sequence_end_code used for indicating the end of a 
video sequence. The condition defined by, the while 
statement is to be true if the: string of bits appearing ; in 
the bit stream ^does not match sequence^end^ode. 
Thus, the do {} while statement described after the 
sequence_lextension ( ) function indicates that data el- 
ements defined by f unctionsln the { ) block following the 
do statement are;described in the bit stream as long as 
sequence^end_code used for indicating the end of.a- 
video sequence does not appear in. the bit stream. 
[0159] After the data 'elements defined by. the 
sequence_extension ( ) function in the'bit stream, :data 
elements defined by an extension_and^user_data(0) 
function are described; The extension_and_user_data 
(0) function isa function used for defining extension data 
and user data of ithe i sequence layer of the MPEG bit ■ 
stream. ■■• " i f *- ■ • ' : > l 

[0160] A do '■ { } while statement following' the 
extension_and_userjidata(0) function is a'functionfto 
extract data elements described by functions in the { } 
block following the do statement from thebit stream ;as 
long as a- condition defined by the- while statement is 
true. The nextbits (^ functions used :ih -the while state- 
ment are functions used to form a judgment as to wheth- 
er or not a bit or a string of bits appearing in the bit stream 
matches picture_start_code orgroupjstart_code start 
codesrespectively by comparing the string within e start ■ 
code specifiecfin the furiction.'lf the string of bits appear-" 
ing in the* bit stream « matches - picture_:Start_code or 
group_start_code, ; a condition ^defined by 'the while 
statement is said to be true. Thus, if picture jstart_code 
or group_start_ 1 code 'appears iri " the bit stream, the 
codes of data elements defined' by functions in the { } 
block following the do statement are described after this 
start code/Accordingly, by'finding-a start code repre- 
sented by picture_start_code or group^siartjcode, it is 
possible to extract data elements defined by functions . 
• « • in the { } block of the do statement from the bit stream. 
[0161] An if-statement described at the beginning of 
the { } . block of the do statement states a condition "if 
group_start_codeappears in the bit stream." A true (sat- 
isfied) condition stated by the if-statement indicates that 
so data elements defined by a group_;of ^picture_header( 1 ) 
function and.an extension and user data(1 ^function are 
described sequentially after group_start_code. > : 
[0162] The group_of_picture_header(1) function is a 
function used for defiriing header data of a GOP layer 
55 of the MPEG bit stream and the extension_and_ 
user_data(1 ) function is a function used for defining ex- 
tension data named extension_data and/or user data 
named user_data of the GOP layer of the MPEG bit 
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stream. 

[0163] Furthermore, in this bit stream, data elements 
defined by a picture_header () function and a 
picture_coding_extenslon ( ) function are described af- 
ter the data elements defined by the group_of_picture_ 
header(1) function and the extension and user data(1) 
function. Of course, if the condition defined by the if- 
statement is not true, the data elements defined by the 
group_of_picture_header(1 ) function and the extension 
and user data(1 ) function are not described, in this case, 
the data elements defined by the picture_header ( ) 
function and the picture_coding_extension ( ) function 
are described after the data elements defined by an 
extenston_and_user_data(0) function. 
[0164] The picture Ji eader ( ) function is a function 
used for defining header data to a picture layer of the 
MPEG bit stream and the picture_coding_extension ( ) 
function is a function used for defining first extension 
data of the picture layer of the MPEG bit stream. 
[0165] The next while statement is a function used for 
defining a condition. A condition defined by each If- 
statement described in a { } block following the condition 
defined by the while statement is judged to be true or 
false as long as the condition defined by the while state- 
ment is true, nextbits ( ) functions used in the while state- 
ment are functions for forming a judgment as to whether 
a string of bits appearing in the bit stream matches 
extension_start_code and user„data_start_code re- 
spectively. If the string of bits appearing in the bit stream 
matches extension_start_code or user_data_start_ 
code, a condition defined by the while statement is said 
to be true. 

[01 66] A first if -statement in the { } block following the 
while statement is a function for forming a judgment as 
to whether or not a string of bits appearing in the bit 
stream matches extension_start_code. A string of bits 
appearing in the bit stream that matches 32-bit 
extension_start_code indicates that data elements de- 
fined by an extension_data(2) function are described af- 
ter extension_start_code in the bit stream. 
[01 67] A second if-statement is a function for forming 
a judgment as to whether or not a string of bits appearing 
in the bit stream matches user_data_start_code. If a 
string of bits appearing in the bit stream matches 32-bit 
user_data_start_code, a condition defined by a third if- 
statement is judged to be true or false. The 
user_data_start_code is a start code used for indicating 
the beginning of a user-data area of the picture layer of 
the MPEG bit stream. 

[01 68] The third if-statement in the { } block following 
the while statement is a function for forming a judgment 
as to whether or not a string of bits appearing in the bit 
stream matches History_DataJD. A string of bits ap- 
pearing in the bit stream that matches 32-bit 
History_DataJD indicates that data elements defined 
by a converted_history_stream () function are de- 
scribed after a code indicated by 32-bit History_Data_ID 
in the user-data area of the picture layer of the MPEG 



bit stream. 

[0169] A converted_history_stream ( ) function is a 
function used for describing history information and his- 
tory data for transmitting all encoding parameters used 

5 in the MPEG encoding process. Details of data ele- 
ments defined by this converted Jiistory_stream () 
function will be described later as history.stream ( ) by 
referring to Figs. 17 to 24. History_Data_ID is a start 
code used for indicating the beginning of a description 

10 of the history information and the history data in the us- 
er-data area of the picture layer of the MPEG bit stream. 
[0170] An else statement is syntax indicating a case 
for a false condition defined by the third if-statement. 
Thus, if data elements defined by a converted_history_ 

is stream ( ) function are not described in the user-data 
area of the picture layer of the MPEG bit stream, data 
elements defined by a user_data () function are de- 
scribed. 

[0171] According to the syntax shown in Fig. 15, his- 
20 tory information is described in converted_history_ 
stream ( ) but not in user.data ( ). The stream referred 
to as converted_history_stream () is described as a 
kind of user_data ( ) conforming to the M PEG standard. 
For this reasons, in some cases, this specification ex- 
25 plains that history information is described in user_data. 
In such cases, the explanation means that the history 
information is described as a kind of user_data conform- 
ing to the MPEG standard. 

[0172] A picture_data ( ) function is a function used 

30 for describing data elements related to a slice layer and 
a macroblock layer after user data of the picture layer 
of the MPEG bit stream. Normally, data elements de- 
fined by this picture_data ( ) function are described after 
data elements defined by a user_data ( ) function or data 

35 elements defined by a converted_history_stream () 
function described in the user-data area of the picture 
layer of the bit stream. If neither extension_start_code 
nor user_data_start_code exists in a bit stream showing 
data elements of the picture layer, however, data ele- 

40 ments defined by this picture_data ( ) function are de- 
scribed after data elements defined by a picture. 
coding_extension ( ) function. 
[0173] Following the data elements defined by this 
picture_data () function, data elements defined by a 

45 sequence Jieader ( ) function and a sequence_exten- 
sion ( ) function are described sequentially. The data el- 
ements described by the sequence_header ( ) function 
and the sequence_extension ( ) function are exactly the 
same data elements as defined by a sequence_header 

so ( ) function and a sequence_extension ( ) function de- 
scribed at the beginning of a sequence of the video 
stream. The reason why the same pieces of data are 
defined in the stream is to prevent data of the sequence 
layer from being no longer receivable, thus, preventing 

55 a stream from being no longer decodable when recep- 
tion of a bit stream is started by a bit stream receiving 
apparatus in the middle of a data stream, such as part 
of bit stream corresponding to a picture layer. 
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[0174] Following the data elements defined by the 
sequence_header ( ) function and the sequence_exten- 
sion ( ) function, that is, at the end of the data stream, 
32-bit sequence_end_code used for indicating the end 
of the sequence is described. s 
[0175] Fig. 1 6 is a schematic diagram showing an out- 
line of the basic configuration of the syntax described 
so far. : 

[0176] Next, a history stream defined byaconverted_ 
history_stream ( ) function is explained. 10 
[0177] The converted_history_stream ( ) function is a 
function used for inserting a history stream;sh owing his- 
tory information into the user-data area of the MPEG pic- 
ture layer. It should be noted that the word 'converted' 
means that the stream has completed- a conversion « 
process^to insert one marker bit for at least every 22 bits 
of the history stream composed of history data to be in- 
serted into the user area ; in order to avoid start emula : 1 
tion. c ' <■■>■ - : • : 

[0178] The converted_history_:stream ( ) function is 20 
described in either one of a format of a ; fixed-length his- 
tory stream shown in Figs. 17 to 23 or a variable-length 
history stream shown in Fig. 24 to be described later. If 
the fixed-length -history stream is selected on the encod- 
er sideVthere is a merit that a circuit and software em- 25 
ployed in the decoder for decoding data- elements from 
the history stream become simple. : r lf the variable-length * : 
history stream is selected on the encoder side, on the 
other hand, the encode'r-is capable of selecting arbitrar- 
ily history info rmati on or data elements described i n th e 30 
user area of the picture layer when necessary.' Thus, the 
amount of data of the history stream can ' be reduced. 
As a result; the data-rate of the bit-stream encoded as 
a whole can also' be lowered aVwell. ' -- : " 

[0179]' The history stream, the history informkioni the 35 
history data and the' history parameter cited in the ex- 
planation 1 of the present invention are encoding param- 
eters or data elements used in the related art encoding ■ 
processes andare not encoding-parameter data used 
in the current encoding process brthe encoding process 40 
carried out at the last-stage?'Consider a case in which 
a picture is encoded and transmitted as an l-picture in 
an encoding process of a first generation, as a P picture 
in an encoding 1 process of a second generation and as 
a B picture in an encoding process of a third generation; 
[0180] Encoding parameters use^in' the encoding- 
process of the third generation are described at prede-' 
termined locations of the -sequence, -GOP, slice and 
macroblock' layers' of an encoded bit stream generated 
as a result of the encoding process of the third genera- so 
tion. On the- other hand, encoding parameters used in 
the encoding process of the first and second genera- 
tions are not recorded in the sequence or GOP layer for 
recording the encoding parameters used in the encod- 
ing process of the third generation, but recorded in the ss 
user-data area of the picture layer as history information 
of the encoding parameters in accordance with the syn- 
tax described above. 



[0181] First of all, the syntax of the fixed-length history 
stream is explained by referring to Figs. 1 7 to 23. 
[0182] In the first place,- encoding parameters related 
to the sequence header of the sequence layer used in 
the previous-encoding processes, that is, the encoding 
processes of typically the first and second generations, 
are inserted as a history stream into the user-data area 
of the picture layer of the bit stream generated in the 
encoding process carried out at the last. stage, that is, 
the encodingprocess of typically the third generation. ill 
•should be noted that history information related to the- 
sequence header of the sequence layer of the bit stream 
generated in the previous encoding processes is-hever 
inserted into the sequence header of the sequence layer 
of the bit stream generated in the encoding process car- 
ried out at the last -stage: ■-' - 
[0183] Data elements related to the sequence header 
(sequence_header) used in the previous encoding proc- 
esses" Include.- sequence_headerjcode J sequence_ ' 
header_present_flag, horizontal_size_value, marker_ 
bit, vertical_size_value'; * aspect_ratio Jnformation, 
framelirate^code, 1 ^brt_ratelyalue, ' ' vbv_buffer_ 
size_vaiue, ^constrainediparameterjlag, load_intra_ 
quantizer_matrix; r "*intra^quantizer_mafrix, load_non_ 
intra_quantizer_matrix and non_intrai:quaritizer_matrix 
as shown irvFig.*17v" - . -" ' ^ ■ 

[0184] The data elements listed above are described, 
as fol lows : The-sequ eh ce_header code data element " 
is a start synchronization code of the sequence layer. ' 
The sequencejtieader _presentiflag data element is a ; 
flag used'for indicating whether data in the sequence 
headeris validorinvalid.The hdriz6ntal_size_value da- 
ta element is data comprising the low-order 12 bits of 
the number of pixels of the picture in the horizontal di- 
rection. The markeVbit data element is bit data inserted " 
for preventing start-code emulation. ' The * vertical_ 
size_value data element-is data comprising low-order 
12 bits of the number of pixels' of the picture in the 1 ver- 
tical direction. The v aspectJ:ratioiinformation data*ele- 
ment is an aspect ratio; that is, a ratio of the height to 
the width of thepicture, or the aspect ratio of the display . 
screen. The frarhe^ratejcode data element is data rep- 
resenting thepicture display period. r 
[0185] The bit_rate_value data-element is data com- 
prising the low-order 18 bits of a bit rate for limiting the 
number of generated bits. The data is rounded up in 
400-bsp units. The vbv_buffer_size_value data element 
is data comprising the low-order 10 bits of a -value for 
determining the size of a virtual buffer (video buffer ver- 
ifier) used in control of the amount of generated code. 
The constrained_parameter_f lag data element is a flag 
used for indicating whether or not parameters are under 
constraint. The load_intra_quantizer_matrix data ele- 
ment is a flag used for indicating whether or not data of 
an intra-MB quantization matrix exists. The 
intra_quantizer_matrix data element is the value of the 
intra-MB quantization matrix. The load_non_intra_ 
quantizermatrix data element is a flag used for indicat- 
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ing whether or not data of a non-intra-MB quantization 
matrix exists. The nonJntra_quantizer_matrix data ele- 
ment is the value of the non-intra-MB quantization ma- 
trix. 

[0186] Subsequently, data elements representing a 5 
sequence extension used in the previous encoding 
processes are described as a history stream in the user- 
data area of the picture layer of the bit stream generated 
in the encoding process carried out at the last stage. 
[0187] Data elements representing the sequence ex- 10 
tension (sequence_extention) used in the previous en- 
coding Include extenslon_start_code, extension. 
start_codeJdentlfier t 
sequence_extension_presentJlag, 
profile_andJevel_indication p progressive_sequence, « 
chromajormat, horizontal_size_extension p vertical.. 
size_extension, bit_rate_extension, vbv_buffer_ 
size_extension, low_delay, frame_rate_extension_n 
and frame_rate_extension_d as shown in Figs. 17 and 
18. 20 
[01 88] The data elements listed above are described 
as follows. The extension start_code_data element is a 
start synchronization code of extension data. The 
extension_start_code_identifier data element is data 
used for indicating which extension data is transmitted. 25 
The sequence_extension_present_flag data element is 
a flag used for indicating whether data in the sequence 
extension is valid or invalid. The profile_andJevel_in- 
dication data element is data specifying a profile and a 
level of the video data. The progress ive_seque nee data 30 
element is data showing that the video data has been 
obtained from sequential scanning. The chromajormat 
data element is data specifying the color-difference for- 
mat of the video data. 

[01 89] The horizontal_size_extension data element is 35 
the two high-order bits data to be added to 
horizontal_size_value of the sequence header. The 
verticaLsize_extension data element is the two high-or- 
der bits data to be added to verticaL_size_value of the 
sequence header. The bit jate_extension data element 40 
is the twelve high-order bits data to be added to 
bit_rate_value of the sequence header. The 
vbv_buffer_size_extension data element is the eight 
high-order bits data to be added to vbv_ 
buffer_size_value of the sequence header. The & 
low_delay data element is data used for indicating that 
a B picture is not included. Theframe_rate_extension_n 
data element is data used for obtaining a frame rate in 
conjunction with frame_rate_code of the sequence 
header. The frame_rate_extension_d data element is so 
data used for obtaining a frame rate in conjunction with 
frame_rate_code of the sequence header. 
[0190] Subsequently, data elements representing a 
sequence-display extension of the sequence layer used 
in the previous encoding processes are described as a 55 
history stream in the user area of the picture layer of the 
bit stream. 

[0191] Data elements described as a sequence-dis- 
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play extension (sequence_display_extension) are 
extension_start_code, extension_starLcodeJdentifier, 
sequence_display_extension_presentJlag, 
videojormat, colour_decription ( colour_primaries, 
transferjjharacteristics, matrix_coefficients, display_ 
horizontal_size and display_vertical_size as shown in 
Fig. 18. 

[0192] The data elements listed above are described 
as follows. The extension_start_code data element is a 
start synchronization code of extension data. The 
extension_start_code_identifier data element is data 
used for indicating which extension data is transmitted. 
The sequence_display_extension_present_flag data 
element is a flag used for indicating whether data ele- 
ments in the sequence display extension are valid or 
invalid. The videojormat data element is data repre- 
senting the video format of the source signal. The 
colour.descrlption data element is data used for indicat- 
ing that detailed data of a color space exists. The 
colour_primaries data element is data showing details 
of a color characteristic of the source signal. The 
transfer_characteristics data element is data showing 
details of how opto-electrical conversion has been car- 
ried out. The matrix_coefficients data element is data 
showing details of how a source signal has been con- 
verted from the three primary colors of light. The 
display_horizontal_size data element is data represent- 
ing the activation area or the horizontal size of an in- 
tended display. The display„vertical_size data element 
is data representing the activation area or the vertical 
size of the intended display. 

[0193] Subsequently, macroblock assignment data 
(named macroblock_assignmentjn_user_data) show- 
ing phase information of a macroblock generated in the 
previous encoding processes is described as a history 
stream in the user area of the picture layer of a b it stream 
generated in the encoding process carried out at the last 
stage. 

[01 94] The macroblock_assignment_in_user_data 
showing phase information of a macroblock comprises 
data elements such as macroblock_assignment_ 
presentjlag, v_phase and h_phase as shown in Fig. 
18. 

[0195] The data elements listed above are described 
as follows. The macroblock_assignment_p resent Jlag 
data element is a flag used for indicating whether data 
elements of macroblock assign ment_in_user_data are 
valid or invalid. The v_phase data element is data show- 
ing phase information in the vertical direction which is 
obtained when the macroblock is detached from picture 
data. The h _phase data element is data showing phase 
information in the horizontal direction which is obtained 
when the macroblock is detached from picture data. 
[0196] Subsequently, data elements representing a 
GOP header of the GOP layer used in the previous en- 
coding processes are described as a history stream in 
the user area of the picture layer of a bit stream gener- 
ated in the encoding process carried out at the last 
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stage. 

[0197] The data elements representing the GOP 
header (group_of_picture_header) are group_start_ 
code, group_of_picture_header_present_flag, time_ 
code, closed_gop and broken link as shown in Fig. 1 8. 5 
[01 98] The data elements listed above are described 
as follows. The group_start_code data element is the 
start synchronization code of the GOP layer. The 
group_of_picture_header_present_flag data element is 
a flag used 'for indicating whether data -elements in 10 
group_of_picture_header are -valid or invalid. The 
time_code data element is a time code showing the 
length of time measured from the beginning of the first 
picture -of the GOP.The closed_gop data.element is a 
flag used for indicating whether op not it is possible to *s 
carry out an.independent playback operation of a picture 
in one GOP from another GOP/ The brokenjirik data 
element is a flag used "fo vindicating whetherornot the 
B picture at the beginning of the GOP can not be repro- 
duced with a high degree of accuracy because . of rea- 20 
sons such as editing. ; " ' 

[0199] ^Subsequently, 'data elements representing -a 
picture header of trTe picture layer used in theprevious * 
encoding processes are described as a history stream 
in the 1 user area of the picture layer of a bit stream gen- 25 
erated in" the 'encoding process "carried out at' the last 
stage/" ■ r A "*-* -" 

[0200] The data elements related to a picture header 
(picture_header) are pictufe_start_code 1 temporaLref- 
erence, picture jcoding_type, vbV'delay, -fulhpeh 30 
forwardlvector;forward_f_code, full_pel backward vec- 
tor and backwardlf code as shown -in Figs. 18and"19:- 
[0201] The'data elements listed above are described 
concretelyas follows. The picture_starticode data ele- 
ment is th e start sy nch ron izatio n code of th e pictu i re I ay- 35 
er. The'temporahreference data element is a number 
used for indicating a display 'order of the picture/This 
number is reset at "the" T beginning of 'the GOP: The 
picture jcoding_type data element is data used for indi- 
cating thetype of the picture. The vbv_delay data ele- 40 
ment is data showing an initial state of a virtual buffer at 
a random access. The full_pel_forward_vector data el- 
ement is a flag used for indicating whether the precision 
of the forward motion vector is expressed in -terms of 
pixel units 'orhalf-pixel units/The forward_f_code data 45 
element is data representing a forward-motion -vector 
search range. The full_pel_backwardlvector data ele-* 
ment is a flag used for indicating whether the precision 
of the backward motion vector is expressed in temns of 
pixel units orhalf-pixel units. The backward_f_code data so 
element is data representing a backward-motion-vector 
search range. 

[0202] Subsequently, data elements representing a 
picture-coding extension of the picture layer used in the 
previous encoding processes are described as a history 55 
stream in the userarea of thepicture layer of a bit stream 
generated in the encoding process carried out at the last 
stage. 



[0203] The data elements related to the picture-cod- 
ing extension (picture_coding_extension) are 
extension_start_code, extension_start_code_identifier, 
Lcode [0][0], Lcode [0][1], f_code [1] [0], f_code 
intra_dc_precision, picture_structure, top_field_first, 
frame_pred_frame_dct, concealment_motion_ivectors, 
q_scale_type, intra_vlc_format 1 alternate_scan, 
repeat_first_field, chroma_420_ : type t progressive^ 
frame, composite_display_flag, v_axis, fieldjsequence, 
sub_carrier, burst_amplitude and sub_carrier_phase as 
shown in Fig. 19. * : 

[0204] The. data elements listed above are described 
as follows. The extension_start_code data element is a 
start code used for indicating the start of extension data 
of the picture layer. The extension_start_code_identifier 
data element is a code used for indicating which exten- 
sion data. is transmitted. Thef_code{0][0] data.element 
is data representing a horizontal motion-vector search 
range in the forward direction: Thef_code [0][1] data 
element'.is data representing a vertical motion -vector 
search ranged the forward direction.. The. r code [4 ][0] 
data element . is data representing a horizontal motion- 
vector search ■ range in the' backward direction. The 
Lcode [1][1] data element is data representing a vertical 
motion-vector search range in the backward direction. 
[0205] The"intra_dc_precision data element is data 
representing :the precision ' of ^DC coefficients. The 
picture_:structure data 'element is data usedfor indicat- 
ing whether the data structured a frame- structure or a 
field structure. In the case of the field -structure, the 
picture_structure data.element also indicates whether 
the field structure is the high-order field or the low-order 
field. The top_fiefd_first data'element is data usedfor 
indicating whether the first field of a. frame 'structure is 
the high-order field ' or " the "low-order field! ' The 
framejpred_frame_dctdata element is data used for in- 
dicating that the prediction of frame-mode' DCT is car- 
ried out- only in the frame-DCT mode in the case of a 
frame structure; The concealment_:motion_vectors data 
element is data-used for indicating that the intra-mac- 
roblock includes ; a~moti on vector for concealing a trans- 
mission error. 

[0206] The c-scale^pe data element is data used 
for indicating whether to use a linear quantization scale 
or a non : linear quantization scale. The intra_ivlc_format 
data element is data used for'indicating whether or not 
another 2-dimensional VLC is used in the intra -macrob- 
lock. The alternate_scan data element is data repre- 
senting selection to use a zigzag scan or an alternate 
scan. The repeat_first_field data element is data used 
in the case of a 2 : 3 pull-down. The chroma^420_type 
data element is data<equal to the value of the next 
progressive_frame data element in the case of a -4 : 2 : 1 
0 signal format or 0 otherwise: The progressive_frame 
data element is data used for indicating whether or not 
this picture has been obtained from sequential scan- 
ning. The composfte_display_flag data element is a flag 
used for indicating whether or not the source signal is a 
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composite signal. 

[0207] The v_axis, field.sequence, sub_carrier, 
burst_amplitude and sub_carrier_phase data elements 
are data used in the case of a PAL source signal. 
[0208] Subsequently, a quantization-matrix extension s 
used in the previous encoding processes is described 
as a history stream in the user area of the picture layer 
of the bit stream generated in the encoding process car- 
ried out at the last stage. 

[0209] Data elements related to the quantization-ma- 10 
trix extension (quanLmatrix_extension) are extension^ 
start_code, extenslon_start_codejdentifier, quant_ 
matrix_extension_present_flag, load_intra_quantizer_ 
matrix, intra_quanttzer_matrix [64], load_non_ 
intra_quantizer_matrix, non_intra_quantizer_matrix 15 
[64], load_chroma_intra_quantizer_matiix, chroma _ 
intra.quantizer matrix [64], load_chroma_non 
intra_quantizer_matrix and chroma_nonjntra_ 
quantizer_matrix [64] as shown in Fig. 20. 
[0210] The data elements listed above are described 20 
as follows. The extension_start_code data element is a 
start code used for indicating the start of the quantiza- 
tion-matrix extension. The extension„starL 
codejdentifier data element is a code used for indicat- 
ing which extension data is transmitted. The 25 
quant_matrix_extension_presentJlag data element is a 
flag used for indicating whether data elements of the 
quantization-matrix extension are valid or invalid. The 
load_intra_quantizer_matrix data element is data used 
for indicating whether or not quantization-matrix data for 30 
an intra-macroblock exists. The tntra_quantizer_matrix 
data element is data representing values of a quantiza- 
tion-matrix for an intra-macroblock. 
[0211] The load_non_intra_quantizer_matrix data el- 
ement is data used for indicating whether or not quan- 35 
tization-matrix data for a non-intra-macroblock exists. 
The non_intra_quantizer_matrix data element is data 
representing values of a quantization-matrix for a non- 
intra-macroblock. The load_chroma_intra_quantizer_ 
matrix data element is data used for indicating whether *o 
or not quantization-matrix data for a color-difference in- 
tra-macroblock exists. The chroma_intra_ 
quantizer_matrix data element is data representing val- 
ues of a quantization-matrix for a color-difference intra- 
macroblock. The load_chroma_non_intra_quantizer_ 45 
matrix data element is data used for indicating whether 
or not quantization-matrix data for a color-difference 
non-intra-macroblock exists. The chroma_non_ 
intra_quantizer_matrix data element is data represent- 
ing values of a quantization-matrix for a color-difference s° 
non-intra-macroblock. 

[0212] Subsequently, a copyright extension used in 
the previous encoding processes is described as a his- 
tory stream in the user area of the picture layer of the 
bit stream generated in the encoding process carried out 55 
at the last stage. 

[0213] Data elements related to the copyright exten- 
sion (copyright_extension) are extension_start_code, 



extension_start_code_identifier, 
copyright„extensionjDresent_flag t copyrightjlag, 
copyrighUdentifter, original_or_copy, copyrighL 
numberj , copy_right_number_2 and copyrighL 
number_3 as shown in Fig. 20. 
[0214] The data elements listed above are described 
as follows. The extension_starLcode data element is a 
start code used for indicating the start of the copyright 
extension. The extension_start_code_identlfier data el- 
ement is a code used for Indicating which extension data 
is transmitted. The copyrighLextension_presentJlag 
data element is a flag used for indicating whether data 
elements of the copyright extension are valid or invalid. 
The copyrightjlag data element is a flag used for indi- 
cating whether or not a copyright has been given to en- 
coded video data in a range up to the next copyright ex- 
tension or the end of the sequence. 
[0215] The copyrlghtjdentifier data element is data 
used for identifying an institution cataloging the copy- 
right specified by the ISO/IEC JTC/SC29. The 
originaLc-r.copy data element is a flag used for indicat- 
ing whether data of the bit stream is original or copied 
data. The copyright_number_1 data element indicates 
bits 44 to 63 of a copyright_number. The 
copyright_number_2 data element indicates bits 22 to 
43 of the copyright number. The copy rig ht_number_3 
data element indicates bits 0 to 21 of the copyright 
number. 

[0216] Subsequently, a picture-display extension 
(picture_display_extension) used in the previous en- 
coding processes is described as a history stream in the 
user area of the picture layer of the bit stream generated 
in the encoding process carried out at the last stage. 
[0217] Data elements representing the picture-dis- 
play extension (picture_display_extension) are 
extension_start_code, extension_start_code_identifier, 
picture_display_extension_present_flag, frame_ 
centre_horizontal_offset_1 , frame__centre_verticaL 
offset_1 , frame_centre_horizontaLoffset_2, f rame_ 
cen t re _vertical_offset_2, frame_centre_horizontal_ 
offset_3 and frame_centre_verticaLoffset_3 as shown 
in Fig. 21. 

[0218] The data elements listed above are described 
as follows. The extension_start_code data element is a 
start code used for indicating the start of the picture-dis- 
play extension. The extension_start_code_identif ier da- 
ta element is a code used for indicating which extension 
data is transmitted. The picture_display_extension_ 
presentjlag data element is a flag used for indicating 
whether data elements of the picture-display extension 
are valid or invalid. The frame_centre_horizontaLoffset 
data element is an offset of the display area in the hor- 
izontal direction and the frame_centre_vertical_offset 
data element is an offset of the display area in the ver- 
tical direction. Up to three offset values of horizontal and 
vertical offsets can be defined respectively. 
[021 9] User data is described as a h istory stream after 
the history information representing the picture-display 
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extension already explained in the user area of the pic- 
ture layer of the bit stream generated in the encoding 
process carried out at the last stage as shown in Fig. 21 . 
[0220] Following the user data, information'on amac- 
roblock used in the previous encoding processes is de- 5 
scribed as a history stream as shown in Figs. 21 to 23. 
[0221] Information on the macroblock comprises data 
elements related to the position of the macroblock, data 
elements related to the mode of the'macroblock, data 
elements related to control of the quantization step, data io 
elements related to motion compensation, - data ele- 
ments related to the pattern of the macroblock and data 
elements'related to the amount of generated code. The 
data elements related to the position of the macroblock 
include such as macroblock_address_h p macroblock. 1$ 
address^v, slice_header_present_flag ■ and skipped^ 
macroblockjlag. The data elements - related to the 
mode of' 1 'the macroblock include such as 
macro block_quant, * ' macroblock_motion_forward ) 
macro block jTiotion^backward, macroblock_pattern f 20 
macroblock intra, spatial_temporal_weight_code_flag, 
f rame2motion_type and dctjype. The data elements 
related to controrbf the quantization step includes such 
as quantiser_scale_code. The data elementsTelatedto 
motion compensaliomnclude PMV'[0][0][0], PMV [0][0] 25 
[1], moti6n>erticaUieid_selert*{6][Of, ; PMV ;: [0][lj[0], 
PMV [0][1][1], motion_vertical_field_select [0][1], PMV 
[1][0][0], PMV il][0][1], moti6n_verticaLfleld_select [1] 
[0], PMV "[1];; [1] ; : [0], PMV [1] [1] [1] and - 
motion^verticaLfield^select [1] [1]. The data elements 30 
related to the pattern of the macroblock include such as 
coded_^block_pattem, arid the data-elements related to' : 
the amount 'of generated code are 'hum_mv_bits, 
num_cbef_bits and num!other_bits or the like; " 
[0222] The data elements related to the macroblock 35 
are described in detail as follows. " 
[0223] The' , macroblock_address_h data element is 
data defining the present absolute position. of the mac- 
roblock' in horizontal direction. The' macroblock_ 
address_v data element Is data defining" the present ab- -40 
solute position of the r macroblock in -vertical direction. 
The slice3eader_present_ifjag data element is a flag r 
used for indicating this macroblock is located at the be- 1 
ginning of a slice layer, and whether or not being accom- 
panied'by a slice header The skipped_macroblock_flag" 45 
data element is' a flag used for indicating whether or not * 1 
to skip this macroblock in a decoding process. 
[0224] The macroblock_quant data element is data 
derived from macroblockltype shown in Fjgs. 38 and 
39. This' data element indicates whether or not so 
quantiser_scale_code appears in the bit stream. The 
macroblock_motiori_forward data element is data de- ' ■ 
rived from the macroblock_type shown in Figs. 38 and 
39 and used in the decoding process. The 
macroblock_motion_backward data element is data de- ss 
rived from the macroblock_type shown in Figs. 38 and 
39 and used in the decoding process. The macroblock 
pattern data element' is data derived from the 



macroblock_type shown in Figs. 38 and 39 and it indi- 
cates whether or not coded_block_pattern appears in 
the bit stream. " 

[0225] The macroblockjntra data element is data de- 
rived from the macroblockjype shown in Figs. 38 and 
39 and used in the decoding process. The 
spatiaLtemporal_weight_code_flag data element is a 
flag derived from the-macrobloc_type shown in Figs. 3B 
and 39 and used for indicating whether or not 
spatial_temporal_weight_code showing an up-sam- 
pling technique of a low-order layer picture with time 
scalability exists 'in the bit stream.- - ; 
[0226] The f rame_motibn_type data element is a 2-bit 
code used forindicatingthe prediction type of the mac- 
roblock of a frame. A frame_motiori_type value of "00" 
indicates that there are two prediction vectors' and the 
prediction "type is a field : based prediction type. A 
frame_motion2type~value of "01 " indicates that there is 
one prediction vector and the predictioh'type is a field- 
based prediction type.- A frame_motion_:type value of 
"1 0" indicates that there is one prediction vector and-the 
prediction type -is/a frame-based prediction type. A ' 
frame_motion^type value of "11" indicates that there is 
one prediction vector and the prediction type is a dual- 
prime prediction type. The field_mdtionltype data^ele^ 
ment is a'2-bit code showing the- motion prediction % of 
the macroblock of a field. A'field.motionitype value of 
"01 " indicates that there is one prediction vector and the 
prediction' type is -a field-based prediction type. A"" 
field_motion_type value of "10" indicates that there is 
two prediction vectors and the prediction type is an 18 
x 8 macroblockrbased predictiontype. A field_motion_ 
type value of "11" ihdicates that-there is one prediction 
vector and the prediction type is a dual-prime prediction 
type. The dct_type data element is data w used'f6rindi- , " 
eating whether the'DCT is carried out in the frame-DCT ' 
mode or the field-DCT mode. The ; quantise r_scalei 
code data element indicates the quantization-step size 
of the macroblock. ■ - * * 

[0227] Next, data J elements related to a motion vector 
are described. In order to reduce the magnitude of amo- 
tion vector required in a decoding process, a particular 
motion vector" is subjected to- an encoding process. by 
actually encoding a difference 1 between s the particular 
motion vector and a motion vector 'decoded earlier. A 
decoder for decoding a motion vector has to sustain four 
motion-vector prediction values, each of which compris- 
es horizontal- and vertical components. These motion- 
vector prediction J values a re rep resented "by PMV : [r][s] 
[v]. The subscript [r] is a flag used for indicating whether 
the motion vector in : a macroblock is the first or second 
vector. To be more specific, an [r] value of "0"- indicates 
the first vector and an [r] value of "1" indicates the sec- 
ond vector. The subscript [s] is a flag usedfor indicating 
whether the direction of the motion vector in the mac- 
roblock is the forward or backward direction . To be more 
specific, an [s] value of "0" indicates the forward direc- 
tion of the motion vector and an [r] value of "1 " indicates 
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the backward direction of the motion vector. The sub- 
script [v] is a flag used for indicating whether the com- 
ponent of the motion vector in the macroblock is a com- 
ponent in the horizontal or vertical direction. To be more 
specific, a [v] value of "0" indicates the horizontal com- s 
ponent of the motion vector and a [v] value of "1" indi- 
cates the vertical component of the motion vector. 
[0228] Thus, PMV [0][0][0] is data representing the 
horizontal component, the forward motion vector of the 
first vector. PMV [0] [0] [1] is data representing the ver- 10 
tical component of the forward motion vector of the first 
vector. PMV [0][1][0] is data representing the horizontal 
component of the backward motion vector of the first 
vector. PMV [0][1][1] is data representing the vertical 
component of the backward motion vector of the first is 
vector. PMV [1] [0] [0] is data representing the horizontal 
component of the forward motion vector of the second 
vector. PMV [1][0][1] is data representing the vertical 
component of the forward motion vector of the second 
vector PMV [1 ][1 ][0] is data representing the horizontal 20 
component of the backward motion vector of the second 
vector. PMV is data representing the vertical 

component of the backward motion vector of the second 
vector. 

[0229] Data referred to as motion_vertical_ 25 
field_seiect [r][s] is data used for indicating which refer- 
enced field of the prediction format is used. To be more 
specific, a motion_vertical_fteld_select [r][s]- value of "0" 
indicates the top referenced field and a motion_ 
vertical_fi el deselect [r][s]-vaiue of " 1 " indicates the bot- 30 
torn referenced field to be used. 
[0230] In motion_vertical_field select [r][s], the sub- 
script [r] is a flag used for indicating whether the motion 
vector in a macroblock is the first or second vector. To 
be more specific, an [r] value of "0" indicates the first 35 
vector and an [r] value of "1 " indicates the second vector. 
The subscript [s] is a flag used for indicating whether the 
direction of the motion vector in the macroblock is the 
forward or backward direction. To be more specific, an 
[s] value of "0" indicates the forward direction of the mo- 40 
tion vector and an [s] value of "1" indicates the backward 
direction of the motion vector. Thus, motion_ 
vertical_field_select [0][0] indicates the referenced field 
used in the generation of the forward motion vector of 
the first vector. motion_verticaLfield_select [0][1] indi- 45 
cates the referenced field used in the generation of the 
backward motion vector of the first vector. 
motion_verticai_field_select [1][0] indicates the refer- 
enced field used in the generation of the forward motion 
vector of the second vector. motion_ vertical_field_se- so 
lect [1 ][1 ] indicates the referenced field used in the gen- 
eration of the backward motion vector of the second vec- 
tor. 

[0231 ] The coded_block_pattern data element is var- 
iable-length data used for indicating which DCT block 55 
among a plurality of DCT blocks each for storing a DCT 
coefficient contains a meaningful or non-zero DCT co- 
efficient. The num_mv_bits data element is data repre- 
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senting the amount of code of the motion vector in the 
macroblock. The num_coef_blts data element is data 
representing the amount of code of the DCT coefficient 
in the macroblock. The num_other_bits data element 
shown in Fig. 46 is data representing the amount of code 
in the macroblock other than the motion vector and the 
DCT coefficient. 

[0232] Next, a syntax for decoding data elements 
from a history stream with a variable length is explained 
by referring to Figs. 24 to 44. 

[0233] As shown in Fig. 24, the history stream with a 
variable length comprises data elements defined by a 
next_start_code () function, a sequence_header () 
function, a sequence_exension ( ) function, an 
extension_and_user_data(0) function, a group_of_ 
picture_header () function, an extension^ 
and_user_data(1) function, a picture_header () func- 
tion, a picture_coding_extenslon ( ) function, a 
re_coding_stream_info () function, an extension. 
and_user_data(2) function and a picture_data ( ) func- 
tion. 

[0234] Since the next_start_code ( ) function is a func- 
tion used for searching a bit stream for a start code, data 
elements defined by the sequence Jieader ( ) function 
and used in the previous encoding processes are de- 
scribed at the beginning of the history stream as shown 
in Fig. 25. 

[0235] Data elements defined by the sequence, 
header () function include sequence_header_code, 
sequence_header_present_flag, horizontal_size_val- 
ue, verticaLsize_value, aspect_ratiojnformation, 
frame_rate_code, bit_rate_value, marker_bit, 
vbv_buffer_size_vaiue, constrained_parameter_flag, 
load_intra_quantizer_matrix, intra_quantizer_matrix, 
load_non_intra_quantizer_matrix and non„intra_ 
quantizerjnatrix as shown in Fig. 25. 
[0236] The data elements listed above are described 
as follows. The sequence_header„code data element 
is the start synchronization code of the sequence layer. 
The sequence_header_present_flag data element is a 
flag used for indicating whether data in sequence., 
header is valid or invalid. The horizonta!_size_value da- 
ta element is data comprising the low-order 12 bits of 
the number of pixels of the picture in the horizontal di- 
rection. The vertical_size_value data element is data 
comprising the low-order 12 bits of the number of pixels 
of the picture in the vertical direction. The 
aspect_ratio_information data element is an aspect ra- 
tio of pixels of a picture, that is, a ratio of the height to 
the width of the picture, or the aspect ratio of the display 
screen. The frame_rate_code data element is data rep- 
resenting the picture display period. The bit_rate_value 
data element is data comprising the low-order 1 8 bits of 
a bit rate for limiting the number of generated bits. The 
data is rounded up in 400-bsp units. 
[0237] The marker_bit data element is bit data insert- 
ed for preventing start-code emulation. The vbv_ 
buffer_size value data element is data comprising the 
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low-order 10 bits of a value for determining the size of 
a virtual buffer (video buffer verifier) used in control of 
the amount of generated code. The constrained_ 
parameter_flag data-element is a flag used for indicating 
whether or not parameters are under constraint. The 
loadjntra_quantizer_matrix data element is a flag used 
for indicating whether or not data'Of an intra-MB quan- 
tization matrix exists. The intra_quantizer_matrix data 
element is the value of the intra-MB quantization matrix. 
The load_non_intra_quantizer_matrix data element is a 
flag used for indicating whether or not data of a non- 
intra-MB quantization matrix exists/ The nori_Jntra_ 
quantizer -matrix data element is the value of the non- 
intra-MB quantization matrix. 

[0238] *" Following the data 'elements defined -by the 
sequerice_header( ) function .data elements defined by 
the sequence_extension ( ) function are' described as a 
history stream asshbwn in Fig. 26. v ' ~' : 
[0239] The data elements defined by the sequence 
extension 1 ( ) function include ^exterisibri_:start_CDde, 
extension2start^code_identifier p - " v - ' 
sequence_extension_present_flag, 
profile3ndjeveliindfcationr ' progress ive^sequence, 
chromalfohnat, horizbntal_;size_extension, vertical. 
size_extensioh, bit_rate_extension, vbvjDuffersize. 
extension, low_delay,' frame_rate_extensiorvn and 
frame_rate^extension^d as shown in -Fig: 26. 
[0240] The'data elements listed ibove are described 
as follows. The extension_stait_code data element is*a 
start synchronization code of extension data. The 
extension_start_codeJdentifier data element is data : 
used foriridicating which Extension data is transmitted. 
The sequence_:extehsioh_:presenrflag data element is 
a flag used for indicating whether data in the sequence 
extension is valid or invalid." The'profilejand _Jevell in- 
dicationdata element is data specifying a profile and a 
level of the video data. The progressive_sequencedata 
element is data ■showing that the video data has been 
obtained from sequentialscanning. The chromaTormat 
data element is data specifying the color-difference for- 
mat of the* video data. The'horizbntal_size_extehsion 
data element is data to "be added to ^horizontal. 
size_value r 6f the sequence header asthe two high-or- 
der bits. The vertical_size_extension data element is 
data to be added to vertical_size_vaiue of the sequence 
header as the two ' high -order bits. The bit_rate_exten- 
sion data element is data to be added to bit_rate_value 
of the sequence header as the 1 2-high-ordeY bits. The 
vbv_buffer_size_extension data element is data to be 
added to vbv_buffer_size_value of the sequence head- 
er as the 8 high-order bits. ' 

[0241] The low_delay data element is data used for 
indicating that a B picture is not included. The 
frame_rate_extension_ r n data element is data used for 
obtaining a frame rate in conjunction with frame. 
rate_code of the sequence header. The frame_rate_ 
extension_d data element is data used for obtaining a 
frame rate in conjunction with frame_rate_code of the 



sequence header. 

[0242] Following the data elements, defined by the 
sequence_extension ( ) function, data elements defined 
by the extension_and_user_data(0) function are de- 
5 scribed as a history stream as shown in Fig. 27. For i 
with a value otherthan 1 , the extension_and_user_data 
(i) function describes only data elements defined by a 
user_data ( ) function as a history stream instead of de- 
scribing data elements defined by the*extension_data 
10 () function. Thus, the extension_and_user_data(0) 
function describes only data elements defined by the 
user_dataX ) function as a history stream. 
[0243] * The userdata ( ) function describes user data 
as a history stream on the basis of a syntax like one 
15 shown in Fig' 28. : 

[0244] Following the data elements defined by the 
extension_:and_user_ciata(0) function, data elements 
defined by the group jof_pictureJheader () function 
shown iriTig. 29 and data elements defined by "the 
20 extension_and_user_data(t) function are described -as 
a history stream. It should be rioted, however, that the 
data elements defined by the grouplof_picture_header 
( ) function * and "data * -elements^ defined • by '-the 
extensiori_arid_user_data(1) function are described on- 1 
25 |y jf grbup_start_code representing the start code of the 
GOP layer is ^described in the history stream. 
[0245] As shown in Fig. 29, the data elements defined^ 
* by the ; grdup_of_picture_header () function are- 

group_start_code, ' ' " 4> 
30 group_ofipicturejheader_present_flag, -■ *time_code^ 
closed_gdp and brokehjink. !i , - 

; - [0246] The ; data elements listed above are described 
as follows. The gr6uplstart_code data elements the 
start synchronization - code of the GOP layer. The 
35 grbup_df^icturel:headerjDresentIflag data element is 
a flag used'for indicating whether data elements in 
group_of_picture_header are valid or invalid. The 
time_code ! data element is a time : code showing the 
length of time measured from the beginning of the first 
■40 picture of the GOP. The closed_gop*data-element is .a 
flag used for indicating whether or not -if is possible to 
carry out an independent playback operation of a picture 
in the GOP from another GOP. The broken Jink data el- 
ement is a~f lag used for indicating that the B picture at 
45 the beginning of the GOP can not be reproducedwith a 
' high degree of accuracy because of reasons such as 
editing. * 1 

[0247] Much like the extension_and_user_data(0) 
functiori,-the extension_and_user_data(1 ) function de- 
50 scribes only data elements defined by the user_data ( ) ■ 
function as a history stream. 

[0248] If group_start_code representing the start 
code of the GOP layer is not described in the history 
stream, the data elements defined by the group_ 
55 of_picture_header ( : ) function and data elements de- 
fined by the extension_and_user_data(1) function are 
also not described in the history stream. In this case, 
data elements defined by the picture_header ( ) function 
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are described after the data elements defined by the 
extension_and_user_data(0) function as a history 
stream. 

[0249] The data elements defined by the 
picture_headr () function are picture_start_code, 5 
temporaLreference, picture_coding_type, vbv_delay, 
fuil_pel_forward_vector ( forwardJ_code, full_pel_ 
backward vector, backward_Lcode, extra_bit_picture 
and extra_information_picture as shown in Fig. 30, 
[0250] The data elements listed above are described 10 
concretely as follows. The picture_start_code data ele- 
ment is the start synchronization code of the picture lay- 
er. The temporaLreference data element is a number 
used for indicating a display order of the picture. This 
number is reset at the beginning of the GOP. The *s 
picture_coding_type data element is data used for indi- 
cating the type of the picture. The vbv_delay data ele- 
ment is data showing an initial state of a virtual buffer at 
a random access. The full_peUorward_vector data el- 
ement is a flag used for indicating whether the precision 20 
of the forward motion vector is expressed in terms of 
integral pixel units or half -pixel units. The forward_f_ 
code data element is data representing a forward-mo- 
tion-vector search range. The full_pel_backward vector 
data element is a flag used for indicating whether the 25 
precision of the backward motion vector is expressed in 
terms of integral pixel units or half -pixel units. The 
backward_f_code data element is data representing a 
backward-motion-vector search range. The extra_ 
bit_picture data element is a flag used for indicating 30 
whether or notfollowing additional information exists. To 
be more specific, extra_bit_picture having a value of "0" 
indicates that no following additional information exists 
while extra_bit ^picture having a value of "I" indicates 
that following additional information exists. The 35 
extra_information_picture data element is information 
reserved by specifications. 

[0251] Following the data elements defined by the 
picture_headr ( ) function, data elements defined by the 
picture_coding_extension ( ) function shown in Fig. 31 40 
are described as a history stream. 
[0252] The data elements defined by the 
picture_coding_extension () function are extension_ 
start_code, extension_start_code_identifier, f_code[0] 
[0], f_code[0][1] t f_code[1][0], f_code[1][1], intra.. 45 
dc_precision, picture_structure, top_field_first, 
frame_predictive_frame_dct ) concealment_motion_ 
vectors, q_scale__type, intra_vlc_format, alternate^ 
scan, repeat _first_field, chroma_420_type ) pro- 
gressive_frame t composite_display_flag, v_axis, so 
field_sequence, sub_carrier, burst_amplitude and 
sub_carrier_phase as shown in Fig. 31 . 
[0253] The data elements listed above are described 
as follows. The extension_start_code data element is a 
start code used for indicating the start of extension data ss 
of the picture layer. The extension_start_code_identif ier 
data element is a code used for indicating which exten- 
sion data is transmitted. The f_code[0][0] data element 



is data representing a horizontal motion-vector search 
range in the forward direction. The f_code[0][1 ] data el- 
ement is data representing a vertical motion-vector 
search range in the forward direction. The f_code[1][0] 
data element is data representing a horizontal motion- 
vector search range in the backward direction. The 
f_code[1][1] data element is data representing a vertical 
motion-vector search range in the backward direction. 
The intra_dc_precision data element is data represent- 
ing the precision of DC coefficients. 
[0254] The picture_structure data element is data 
used for indicating whether the data structure is a frame 
structure or a field structure. In addition, in the case of 
the field structure, the picture_structure data element al- 
so indicates whetherthe field structure is the high-order 
field or the low-order field. The topjieldjirst data ele- 
ment is data used for indicating whether the first field of 
a frame structure is the high-order field or the low-order 
field. The frame_predictive_frame_dct data element is 
data used for indicating that the prediction of frame- 
mode DCT is carried out only in the frame mode in the 
case of a frame structure. The concealmenL 
motion_vectors data element is data used for indicating 
that the intra-macro block includes a motion vector for 
concealing a transmission error. The q_scale_type data 
element is data used for indicating whether to use a lin- 
ear quantization scale or a non-linear quantization 
scale. The intra_vlc_format data element is data used 
for indicating whether or not another 2-dimensional VLC 
is used in the intra-macroblock. 
[0255] The alternate_scan data element is data rep- 
resenting selection to use a zigzag scan or an alternate 
scan. The repeat_first_field data element is data used 
in the case of a 2 : 3 pull-down. The chroma_420_type 
data element is data equal to the value of the next 
progressive_frame data element in the case of a 4 : 2 : 
0 signal format or 0 otherwise. The progressivejrame 
data element is data used for indicating whether or not 
this picture has been obtained from sequential scan- 
ning. The composite_display_flag data element is data 
used for indicating whether or not the source signal is a 
composite signal. The v_axis, field_sequence, 
sub_carrier, burst_amplitude and sub_carrier_phase 
data elements are data used in the case of a PAL source 
signal. 

[0256] Following the data elements defined by the 
picture_coding_extension ( ) function, data elements 
defined by the re_coding_stream_info ( ) function are 
described as a history stream. The re_coding_ 
stream_info ( ) function is used mainly for describing a 
combination of pieces of history information. Details of 
the re_coding_stream_info ( ) function will be described 
later by referring to Fig. 48. 

[0257] Following the data elements defined by the 
re_coding_stream_info ( ) function, data elements de- 
fined by the extension_and_user_data(2) function 
shown in Fig. 27 are described as a history stream. It 
should be noted, however, that data elements defined 
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by the extension_data ( ) function are described by the 
extension_and_user_data(2) function only if 
extension_start_code representing the start code of the 
extension exists in the bit stream. In addition, data ele- 
ments defined by the user_data ()*f unction are de- 5 
scribed by the extensiorijand_user_data(2) function af- • 
ter the data elements defined by the extension data ( ) 
function only if user_data_start_code representing the 
start code of the user data exists in the bit stream as 
shown in as showh' in Fig. 27. That is to say, if neither -io 
the start code*of the extension ^or the start codeof the 
user data exists in the bit stream',' data-elements defined * 
by the extension_data ( ) function and data elements de- 
fined'by the user_data (^ function are not described in' 
the bft stream. ' ' : L - ; ' 15 

[0258] The extens ion_data' ! ( ) function is a function 
used for describing a "data element representing 
extensi'on_start_code and* data ^elements defined 'by a 
quant_matrix_extensibn ( /function, a'copyright_exten- 
sion () function- and a picture_displayj:extehsion () - 20 
function as a history stream in the brt stream as shown 
in Fig. 32. 

[0259] - Data" elements defined 'by the^quantimatrix^ 
extension () 'function *' ; are f ' extension_start„code, • 
extension_start3ddelidentifier, quant_matrix_,exteri- 25 
sion.presehUflag, : - loadjntraiquantizerimatrix, * 
intra Jquahti2er_matrix[64], loadlK6nwntra_quantizef_ 
matrix , i non_intra'2qu a riti2eLrnatrix[64]. loadichroma_ 
intra_quantizer_matrix, chromdjihtra_quantizer_matrix 
[64], ' 1oad„chrbmal:hon_ihtra_:quantizer_matrix * and 3d 
chroma_hon Jntrajq uantizef_matrix[64] as sh own 7 i n ' 
Fig. 33. ' ■' ' " ' - ' ■ " 
[0260] The data elements listed above are described 
as f o 1 1 ows . Th e extens i o n_start_code data el em ent is a 
start code used f o r inSicatin g th e' start' of the q u ahtiza- " "35 
tion-matrix extension. The extension_start_code_iden- 
trfier data element is a code used for ihdicating-which 
extension 1 data is ! transmitted. The * quanta 
matrix_extehsibn_presentiflag data element is a flag 
used for indicating whether data elements of the quart 1 40 
tization-matrix extension are valid or 'invalid. The 
load_intralquantizer_mafrix data element is data' used 
for indicating whether or not quantization -matrix data for 
an intra-macroblbck exists. The intra_quantizer matrix 
data element is data representing values of a [ qu ahtiza- *s 
tion-matrixforanintra-macroblock. 
[0261] ' "The load_non_intra2quantizer_matrix data el- 
ement is data used for indicating whether or not quan- 
tization-matrix data for a'non-intra-macroblock exists. 
The non_intra_quantizer matrix data element is data so 
representing values of a quantization-matrix for a non- 
intra-macro block. The 
load_chroma_intra_quantizer_matrix data -element is 
data used for indicating whether or not'quantization-ma- 
trix data for a color-difference intra-macroblock exists. 55 
The chroma J ntra_quantizer_matrix data element is da- 
ta representing values of a quantization-matrix for a 
color-difference intra-macroblock. The load_ 



chroma_nonjntra_quantizer_matrix data element is 
data used for indicating whether or not quantization-ma- 
trix data for a color-difference non-intra-macroblock ex- 
ists. The chroma_non_intra_quantizer_matrix data ele- 
ment is data representing values ofa quantization-ma- 
trix fora color-difference non-intra-macroblock. 
[0262] The data elements defined by the 
copyright_extension (-) function are extension_ 
start_,code. extens ion j:start_code2identifier,. copy rig ht_ 
extension_present_flag, ^ copyrighting, copyright., 
identifier, :original_or_copy t copyright_number_1 , 
copy_right^;number2 -and copyright^ umber_3 as ~ 
shown in Fig. 34: ' - m 

[0263] The data elements listed above are described 
as follows/The extension^start_code.data element is?a 
start code-used for indicating ; the start of the* copyright 
extension:' The-extension_start^code_identifier data el- 
ement is acode usedfor indicating which extension data 
is transmitted. The -copyright_extension_present_f lag 
data element is a flag used for indicating whether data 
elements of the copyright extension are .valid or, invalid. 
[0264] Thecopyright£fiag data element is a flagused 
for indicating whether or not a copyright has been"given 
to encoded videodata in a range up to the next copyright 
extension or the end" of "the -sequence; The 
copyrighHdentifier data element is dataused for iden- 
tifying" an ^institution cataloging the copyright -specified 
by the -ISO/I EC JTC/SC29. The original_;or_copy data 
element is a flag used for indicating whether data of the 
bit stream -is original or- copied 'data. The copyright 
number 1 data element indicates bits 44-to 63 of a cop- 
yright "number The copy rig ht_number_2 data element 
indicates bits 22 : to 43 of the copyright number. The 
copyright_number_3 data element indicates;bits 0 to 21 
of the'cbpyright'nt^ — ^ — 

[0265] The data ^elements ' defined by the 
picture_display_extension . (") function are -extens ibri_ 
start_codeJdentifier, frame_centerJ:horizontakoffset 
and frame_center_vertical_offset=as shown in Fig.: 35. 
[0266] The data elements listed above are described 
as follows. The extension_start_codeJdentifier data el-, 
ement is a code used for indicating which extension data 
is transmitted'Thef rame_cenfer_horizontal_offset data 
element is an offset of the display area in the -horizontal 
direction. The number of such Horizontal offsets can be 
defined by number_of_frame_center_offsets. The 
frame_center_vertical_ioffset data element is an offset 
of the display area in the vertical direction. The number 
of such vertical offsets can be defined by 
number_:of_frame_center_offsets. " — ' 

[0267] As shown in the variable-length history stream 
of Fig. 24, data elements defined by a picture_data ( ) 
function are described as a history stream after the data . 
elements defined by the extension_and_user(2) func- 
tion. It should be noted, however; that the picture_data * 
( ) function exists if red_bw_flag has a ! value other than 
1 or red_bw_indicator has 1 a value not exceeding 2. The 
red_bw_flag and the red_bw_indicator are described in 
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the re_coding_streamjnfo ( ) function and will be de- 
scribed later by referring to Figs, 48 and 49, 
[0268] As shown in Fig. 36, the data elements defined 
by a picture_data ( ) function are data elements defined 
by a slice ( ) function. It should be noted that at least one 
of the data elements defined by the slice ( ) function are 
described in the bit stream. 

[0269] As shown in Fig. 37, the slice ( ) function is a 
function used for describing data elements such as 
slice_start_code, sllce_quantiser_scale_code, intra_ 
slicejlag, intra_slice, reserved_bits, extra_bit_slice, 
extraJnformation_sllce and extra bit slice and data el- 
ements defined by a macroblock ( ) function as a history 
stream. 

[0270] The data elements listed above are described 
as follows. The slice_start_code data element is a start 
code used for indicating the data elements defined by 
the slice ( ) function. The slice_quantlser_scale_code 
data element is the size of the quantization step defined 
for a macroblock existing in the slice layer. However, 
quantiser„scale_codesetfor macroblocks is preferably 
used, when quantiser_scale_code has been set. 
[0271] The intra_slicejlag data segment is a flag 
used for indicating whether or not intra_slice and 
reserved_bits exist in the bit stream. The intra_slice data 
element is a flag used for indicating whether or not a 
non-intra-macroblock exists in the slice layer. To be 
more specific, if any one of macroblocks in the slice layer 
is a non-intra-macroblock, the intra_slice flag has a val- 
ue of "0". If ail macroblocks in the slice layer are non- 
intra-macroblocks, on the other hand, the intra_sf ice flag 
has a value of "1". The reserved_brts data element is 
7-bit data having a value of "0". The extra_bit„slice data 
element is a flag used for indicating whether or not the 
extra_information_s(ice data element, that is, informa- 
tion added as a history stream, exists. To be more spe- 
cific, if the nextextra_information_slice data element ex- 
ists, the extra_bit_slice flag has a value of "1 ". If the next 
extrajnformation_slice data element does not exist, on 
the other hand, the extra_bit_slice flag has a value of 
"0". 

[0272] Following the data element defined by the slice 
( ) function, data elements defined by a macroblock ( ) 
function are described as a history stream. 
[0273] As shown in Fig. 38, the macroblock ( ) func- 
tion are a function used for defining data elements such 
as macroblock_escape, macroblock_address_incre- 
ment, macroblock_quantiser_scale_code and 
markerjDit as well as data elements defined by a 
macroblock_modes () function, a motion_vectors{s) 
function and a coded_block_pattem ( ) function. 
[0274] The data elements listed above are described 
as follows. The macroblock_escape data element is a 
string of bits with a fixed length used for indicating 
whether or not a difference in the horizontal direction 
between a referenced macroblock and a preceding 
macroblock is at least 34 or greater. If the difference in 
the horizontal direction between a referenced macrob- 
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lock and a preceding macroblock is at least 34 or great- 
er, 33 is added to the value of the macroblock. 
addressjncrement data element. The macroblock_ 
address .Increment data element is the difference in the 

5 horizontal direction between a referenced macroblock 
and a preceding macroblock. If one macroblock_escape 
data element exists before the macroblock. 
addressjncrement data element, a value obtained as 
a result of the addition of 33 to the value of the 

10 macroblock_addres$Jncrement data element repre- 
sents the actual difference in the horizontal direction be- 
tween a referenced macroblock and a preceding mac- 
roblock. 

[0275] The macroblock j}uantiser_scale_code data 
is element is the size of the quantization step set in each 
macroblock and exists only if the value of 
macroblock_quant is 1. The siice_quantiser_ 
scale_code data element representing the size of the 
quantization step of a slice layer is also set in each slice 
20 layer. However, macroblock_scale_code set for a mac- 
roblock takes precedence of sllce_quantiser_ 
scale_code 

[0276] Following the macroblock.address .Increment 
data element, data elements defined by the 

25 macroblockjnodes () function are described. As 
shown in Fig. 39, the macroblockjnodes ( ) function is 
a function used for describing data elements such as 
macroblock_type, framejnotion_type, field_motion_ 
type and dct.type as a history stream. 

30 [0277] The data elements listed above are described 
as follows. The macroblockjype data element is data 
representing the encoding type of the macroblock. Its 
details will be described by referring to Figs. 42 to 44. 
[0278] If the macroblock jnotion Jorward flag or the 

35 macroblock jriotion_backward flag has a value of "1", 
the picture is transferred in the frame-prediction mode 
and, in addition, frame_pred_frame_dct has a value of 
"0", a data element representing frame jnotion_type is 
described after a data element representing 

40 macroblock.type. . It should be noted that 
frame_pred_frame_dct is a flag used for indicating 
whether or not frame_motion_type exists in the bit 
stream. 

[0279] The f rame_motion_type data element is a 2-bit 
45 code showing the prediction type of the macroblock of 
the frame. A f ramejnotionjype value of "OO" indicates 
that there are two prediction vectors and the prediction 
type is a field-based prediction type. A frame_motion_ 
type value of "01" indicates that there is one prediction 
so vector and the prediction type is a field-based prediction 
type. A frame_motion_type value of "1 0" indicates that 
there is one prediction vector and the prediction type is 
a frame-based prediction type. A frame_motion_type 
value of "1 1 " indicates that there is one prediction vector 
55 and the prediction type is a dual-prime prediction type. 
[0280] If a condition describing f rame jnotion_type is 
not satisfied, a data element representing 
field jnotion_type is described after a data element rep- 
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resenting macroblock_type. 

[0281] The field_motion_type data element is a 2-bit 
code showing the motion prediction of the macroblock 
of a field. A field_motion_type value of "01" indicates 
that there is one prediction vector and the prediction s 
type is -a field-based prediction type. A field_motion_ 
type value of "10" indicates that there is two prediction 
vectors and the prediction type is a 1B x 8 macroblock- 
based prediction type. A fieldjrnotion_type value of "1 1 " 
indicates that there is one prediction vector and the pre- 10 
diction type is a dual-prime prediction type: 
[0282] - If the picture is transferred in the frame predic- 
tion mode, frame_predjrame_dct indicates that 
frame_mbtion_type exists~ : in the- bit stream and 
frarne_pred_frame_dctalso indicates that dct_type ex- is 
ists in the bit stream, a data element representing 
dct_type is described after a data element representing 
macroblockjype. It should-be noted that the' dct_type 
data element is data used for indicating whether the 
DCTis carried.butin .the frame-DCTmode or the field- 20 
DCTmode; ~' :V ! ' " 
[0283] As "shown* in Fig. 3B, if the referenced macrob- 
lock is either a forward-prediction macroblock oraniri- 
tra-macroblock completing conceal processing, a data " 
element defined'by a mbtibn_vectors(0) 'function is de- 25 
scribed'.-lf the referenced macroblock is -a backward- 
prediction macroblock, a data element defined by a 
motion_Vectors(1) function is described. It should be 
noted that the motion_vectors(0) function is a function 
used for describing a data element related to a first mo- 30 
tion vector and the motion_vectors(1 ) function is a func- 
tion used for describing a data element related to a sec- 
ond motion vector. - 

[0284] As : shown in Fig; 40, the motion_vectors(s) 
function is a function used for describing a data element ' 35 
related to a mbtiori vector. ' 
[0285] 1 Ifthere is one motion vector and the dual-prime 
prediction mode is' not used, data elements defined by 
motion_yerticarfield_select[0][s] : and motion_vector[0] 
[s] are described. 40 
[0286] ; The motionivertical_field_select[r][s] is a flag 
used for indicating that the first vector, be it a fbrward- 
predictiorT or backward-prediction" vector, is -a ' Vector 
made by referencing the bottom field or the top field. The 
subscript]?] indicates the first or'second vector whereas *s 
the subscripts] indicates a forward-prediction or back- 
ward-prediction vector. ' 

[0287] As shown in Fig. 41 , the motion_vector(r, s) 
functionVa function used for describing a data array 
related to moti6h_lcode[r][s][t], a data array related to so 
motion2residual[r][s][t] and data representing dmvector 
[t]. 

[0288] The motion_code[r][s][t] is data with a variable 
length used for representing the maghitudeof a motion 
vector in terms of a value in the range -16 'to +16. ss 
motion_residual[r][s]tt] 'is data with a variable length 
used for representing a residual of a motion vector. 
Thus, by using the values of motion_code[r][s][t] and 



motion_residual[r][s][t], a detailed motion vector can be 
described. The dmvectorp] is data used for scaling an 
existing motion vector with a time distance in order to 
generate a motion vector in one of the top and bottom 
fields (for example, the top field) in the dual-prime pre- 
diction mode and used for correction in the vertical di- 
rection in order to reflect a shift in the vertical direction 
between lines of the top and bottom fields. -The subscript 
[r] indicates the'first or second vector whereas the sub- 
scripts] indicates a forward-prediction or backward-pre- 
diction vector. Thesubscriptp] indicates that the motion 
vector is a component in the vertical or horizontal direc- ; 
tion. 

[0289] First of all, the motion -vector(r, s) function de- 
scribes a data array to represent motion_code[r][s][0] in 
the horizontal direction as a history stream as shown in 
Fig. 41 . The number of bits of both motion_residual [0] 
[s][t] and r motion_residual [1][s] [t]' is "rep resented by 
f_code [s][t]. Thus, a value of fjcode[s][t] other than "1 " 
indicates that motion_residual[r][s][t] exists ^in the bit 
strearh "The fact that motion_residual[r][s][0], a horizon- 
tal-direction component, is not "1" and motion_code[r] 
[s][0], a horizontal-direction- component^is^not "0" indi- 
cates that a data element representing motion_residual 
[r][s][0] is included in the bit stream and the horizontal- 
direction component of the motion vector exists/ In' this 
case, a data element representingrnotion_residual[r][s] 
[0], a horizontal component, is thus described. 
[0290] Subsequently, a data array to -represent 
motion_code[r]fs][1 ] is described in the vertical direction 
as a history stream. Likewise, the number of bits of both 
motion_residual[0][s][t] and motion_residual[1][s][t] is 
represented -by f_code[s][t]. Thus, a value of f_code[s] 
[t] other than "1" "indicates that^motion_residuai[r][s][t] 
exists'in the bit strearriTThe f act that motioh^resiclual [r] " T 
[s][1], a vertical-direction compbnerit,.;is not"1" and 
motionjcode[r][s][1], a vertical-direction component, is 
not "0" indicates that a data element representing 
motion_residual[r][s][1] is included imthe bit stream and 
the vertical-di rectib n component of the motion vector ex- 
ists. In this case,' a data element -representing 
motion_residual[r][s][1], a vertical : cdmponent,- is thus 
described. " ^ 
[0291] Next, macroblock_type is described by refer- 
ring to Figs. 42 to" 44. The macroblock_type data ele- 
ment is data wfth;a variable length-generated from flags - 
such as macroblock_quant; - dcrtype_flag, 
macroblock_motion_forward and macroblock_motion 
backward as shown ! in Figs.' 42 to 44. The 
macroblock_quant flag is a flag used for indicating 
whether or not macroblock^quantise^scale^ode-'for 
setting the size of the quantization step for the macrob- 
lock is set. If macroblock_quantiser_scale_code exists 
in the bit stream, the macroblock_quant flag-has. a value 
of'T'. 

[0292] A flag referred to as dct_type_flag is a flag 
used for indicating whether or not dct_type showing that 
the referenced macroblock has been encoded in the 
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f rame-DCT mode or the field-DCT mode exists. In other 
words, dctjype Jlag is a flag used for Indicating wheth- 
er or not the referenced macroblock experienced DCT. 
If dctjype exists in the bit stream, dctjype Jlag has a 
value of "1". The macroblock_motionJorward is a flag 5 
showing whether or not the referenced macroblock has 
undergone forward prediction. If the referenced macrob- 
lock has undergone forward prediction, the 
macroblock_motion_forward flag has a value of "1 ". On 
the other hand, macroblockjmotlon Jaackward is a flag '0 
showing whether or not the referenced macroblock has 
undergone backward prediction. If the referenced mac- 
roblock has undergone backward prediction, the 
macroblock_motion_backward flag has a value of "1". 
[0293] It should be noted that, in the variable-length ^ 
format, the history information can be eliminated in order 
to reduce the transfer rate of transmitted bits. 
[0294] For example, in order to transfer 
macro blockjype and motion_vectors (), but not to 
transfer quantiser_scale_code, slice_quantiser_ 20 
scale.code is set at "00000" in order to reduce the bit 
rate. 

[0295] In addition, in order to transfer only 
macroblockjype but not to transfer motion_vectors ( ), 
quantiser_scale_code and dctjype, "not_coded" is 25 
used as macroblockjype in order to reduce the bit rate. 
[0296] Furthermore, in order to transfer only 
picture_codingjype but not to transfer all information 
following slice (), picture jiata () having no 
slice_start_code is used in order to reduce the bit rate. 30 
[0297] As described above, in order to prevent 23 
consecutive bits of 0 from appearing in user_data, a "1 " 
bit is inserted for every 22 bits. It should be noted that, 
however, a "1 " bit can also be inserted for each number 
of bits smaller than 22. In addition, instead of insertion 35 
of a "1 " bit by counting the number of consecutive 0 bits, 
a "1 " bit can also be inserted by examining Byte_allign. 
[0298] In addition, in theMPEG, generation of 23 con- 
secutive bits of 0 is prohibited. In actuality, however, only 
a sequence of such 23 bits starting from the beginning 40 
of a byte is a problem. That is to say, a sequence of such 
23 bits not starting from the beginning of a byte is not a 
problem. Thus, a "1 " bit may be inserted for each typi- 
cally 24 bits at a position other than the LSB. 
[0299] Furthermore, while the history information is 
made in a format close to a video elementary stream as 
described above, the history information can also be 
made in a format close to a packetized elementary 
stream or a transport stream. In addition, even though 
user_data of the Elementary Stream is placed in front so 
of picture_data according to the above description, 
user_data can be placed at another location as well. 
[0300] The transponding system shown in Fig. 4 out- 
puts encoding parameters of 4 generations as history 
information to the succeeding stage. In actuality, how- 55 
ever, the history information is not all required. The re- 
quired history information varies from application to ap- 
plication. In addition, each actual transmission line and 



each recording medium or each transmission medium 
has a capacity limit. Even if history information is com- 
pressed, transmission of all the history information is a 
big load to be borne by a transmission means having a 
limited transmission capacity. In consequence, the bit 
rate of the picture bit stream must be unavoidably sup- 
pressed, inadvertently losing the effectiveness of the 
transmission of the history information. 
[0301] In order to solve this problem, a descriptorde- 
scribing a combination of items transmitted as history 
information is also transmitted to the succeeding stage 
by including the descriptor in the history information. In- 
stead of transmitting all history Information, 
[0302] information to be transmitted is varied from ap- 
plication to application for a variety of applications. Fig. 
45 is a diagram showing a typical configuration of a 
transcoding system in which information to be transmit- 
ted Is varied from application to application for a variety 
of applications. 

[0303] Components of the transcoding system shown 
in Fig. 45, which are identical with those employed in 
the transcoding system shown in Fig. 4, are denoted by 
the same reference numerals as the latter and their ex- 
planation is not repeated. In the typical configuration 
shown in Fig. 45, an encoding-parameter-selecting cir- 
cuit 1 51 Is provided between a history-information-sep- 
arating apparatus 64 and an encoding apparatus 66 as 
well as between a history-encoding apparatus 65 and 
the encoding apparatus 66. 

[0304] The encoding-parameter-selecting circuit 151 
comprises a combination -descriptor-separating unit 
161 , an encoding-parameter-computing unit 162 and a 
switch 163. The encoding-parameter-computing unit 
162 computes encoding parameters from a base-band 
video signal output by the history-information-separat- 
ing apparatus 64. The combination-descriptor-separat- 
ing unit 161 separates encoding parameters and de- 
scriptors based on information on encoding parameters 
that are determined to be most optimum for an encoding 
process carried out by the video-encoding system 141 
including the encoding-parameter-selecting circuit 151 . 
The encoding parameters are output by encoding-pa- 
rameter-computing unit 162 on the basis of the base- 
band video signal output by the history-information-sep- 
arating apparatus 64. An example of optimum encoding 
parameters is encoding parameters of the second gen- 
eration. An example of the descriptors is red_bwjlag 
and red_bw_indicator, which will be described later by 
referring to Fig. 49. The switch 163 selects either the 
encoding parameters separated by the combination-de- 
scriptor-separating unit 161 orthe encoding parameters 
computed by the encoding-parameter-computing unit 
1 62 in accordance with the descriptors separated by the 
combination-descriptor-separating unit 161, and sup- 
plies the selected parameters to the encoding apparatus 
66. The rest of the configuration is the same as that 
shown in Fig. 4. 

[0305] A combination of items transmitted as history 
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information is explained as follows. History information 
can be classified into information for each picture and 
information for each macroblock. Information for a slice 
can be obtained by gathering pieces of information for 
macroblocks included in the slice. By the same token, 5 
information for a GOP can be obtained by gathering 
pieces of information for pictures-included in the GOP. 
[0306] Since information for a picture, that is, informa- . 
tion described in a V Blanking area shown in Fig. 7, is 
transmitted only once for each frame, the bit rate forthe 10 
transmission of the information is not that high. On the 
other hand. since information for a macroblock, 'that is; ' 
information described in an H-blanking area shown in 
Fig. 7, needs to be transmitted a large number of times 
for each frame, information for each macroblock occu- is 
pies a large portion of history information. Assume for ' 
example a video system'in which the number of scan- 
ning lines in 1 frame is 525, the field rate is 60 fields per 
second and the number of pixels perframe is 720 X 480. 
In this case, information for a macroblock needs to be 20 
transmitted 1 ,350 (= (720/1 6) X (480/16)) times for each - 1 
frame. "Accordingly, information for macroblocks occu- 
pies a large portion of history information. "In -order to 
solve this problem, while transmitted history information 
always includes at least information for each picture, in- 25 
formation for each macroblock is transmitted selectively 
corresporitiingto the application,' ^ this way, theamount : 
of transmitted information can be suppressed. v 
[0307] Information to be 'transmitted as history infor- 
mation 'for each* macroblock includes num_coef_ibits, 30 
num_mv_bits, num_other_bits, q_scale_ : code l q_ 
scaie.type- motion.type.'mv^ertjield.sel [-][], mv[] 
[][]. "rribimfwd, mb^mbwd, mb_p'attern, coded_ 
block_patterrv mb_intra, -slice_start, ; dctjype, 
mb_quarit and skipped_mb. These are expressecl by" 35* 
using elements of macroblock rate information. 
[0308] The above pieces of information are described 
as follows. The num^coefjbits information is the size of - " 1 
codes 'in the'macroblock required for expressing^ DCT 
coefficients . The num jmv_bits information is the size of 40 
a code in the macroblock required for expressing a mo- 
tion vector. The num^therbits information ' is the size 
of codes in the'rnacroblock otherthan'those represented ' 
by num_coef_bits and num^rmrbits/ 
[0309] The q_scale_code information is q_scale_- -45 
code applied tothe : macroblock. The motion_type infor : 
mation is the type of a motion vector applied to the mac- 
roblock. The mv_vert_f ield_se![ ][ ] information is a field 
select of a motion vector applied to the macroblock. 
[0310] The mv[ ]][ [ ] information is a motion vector ap- so 
plied to the macroblock. The mb_mfwd information is a 
flag indicating that the prediction mode of the macrob-* 
lock is the forward-direction prediction mode. The 
rnb_mbwd information is a flag indicating that the pre- 
diction mode of the macroblock is the backward-direc- ss 
tion prediction mode. The mb_pattem information is a 
flag indicating the presence/absence of a non-zero DCT 
coefficient of the macroblock. 



[031 1] The coded_block_pattern information is a flag 
indicating the presence/absence of a non-zero DCT co- 
efficient of the macroblock .for each DCT block. The 
mb_intra information is a flag indicating whether or not 
the macroblock is an intra_macro macroblock. The 
slice_start information is a flag indicating whether or not 
the macroblock is located at the beginning of a slice. 
The dctjype information is a flag indicating whether the 
macroblock is a field_dcf or frame_dct macroblock. 
[0312] The mbjquant information is a flag indicating 
whether or 'not the transmitted macroblock includes 
quantiser_scale_code.-Theskipped_mb information is 
a flag indicating whether or not the macroblock is a 
skipped macroblock.- ■ * ....v. 
[0313] The items described above are not always all 
needed. Instead, the needed items are determined in 
accordance- with the application. "For example, the 
num_coef_bits and, slice_:start' items are needed- in an 
application with a transparent requirement to restore a 
bit stream, which is to be re-encoded, to a form as close 
to the original bitrstream as possible. In other words, *ih 
an application changing the bft rate, these items are not 
required. In addition, ^applications with very strict restric- 
tions on the transmission 'line include applications that 
need to' know only the encoding type % of;each picture. In 
such a condition, combinations each comprising items 
for transmitting historyinformation are conceivable. Fig: 
46 is a diagram showing such typical combinations. 
[0314] : For each of the combinations shownin Fig. 46, 
a value of 2 indicates' that an item associated -with the 
value is included in'.the. combination and can be used 
whereas a value of 0 means that the item* is not included 
in the combination. A value-oM implies that the item is 
included in the combination as auxiliary information or 
simply for a* syntactical reason . 'However, the^item" "has ' 
nothing to do" with the information of 'the original bit 
stream. Thus, : the item itself is meaningless. Tor exam- 
ple, a value of : 1 -is assigned to the slice^start* item in 
combinations 3 and 4 indicates that the' macroblock is 
located at the beginning of a slice in the transmission of 
history information. However, the location of the slice is' 
not necessarily the same as' that in^the 1 originarbit 
stream. If the location of "the slice is changed, this item 
does not have any-meaning as history -iriformation. 
[0315] By"'includirig or excluding some of (num_ 
coef_bits, numimvjbits, num_other_bits), ^ (q_scale_ 
code, q_scale_type)r (motion£type, ~mv_vert_field_sel 
[ ] [ ]. mv[ ] [ ] [ ]), (mb_mfwd, mb_mbwd), (mb_pattern), 
(coded_block_pattem); (mbjntra), (slice_start), 
(dct_type), (mb_quant) and (skipped_mb) items as 
shown in the example of Fig. 46 in '5 combinations, 
namely, combinations 1 to 5, are obtained. 
[0316] Combination 1 is a combination intended for 
rebuilding a completely transparent bit stream. With this 
combination, it impossible to implement transcoding with 
high precision due to the use of information on the 
number of generated codes. Combination 2 is also a 
combination intended for rebuilding a completely trans- 
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parent bit stream. Even though combination 3 cannot 
be used for rebuilding a completely transparent bit 
stream, combination 3 is a combination intended for re- 
building a bit stream almost transparent to the sense of 
sight. From the transparency point of view, combination 
4 is inferiorto combination 3. Nevertheless, combination 
4 is a combination that can be used for rebuilding a bit 
stream with no problem appearing to the sense of sight. 
From the transparency point of view, combination 5 is 
inferior to combination 4. However, combination 5 is a 
combination that can be used for imperfect rebuilding of 
a bit stream with little history information. 
[0317] The lower the number assigned to any of the 
above combinations, the better the function of the com- 
bination but the larger the capacity required for trans- 
mission of the history information. It is thus necessary 
to select a combination to be transferred by considering 
the assumed application and the transmission capacity 
useable for the history information. 
[0318] The following description explains the opera- 
tion of the transcoding system shown in Fig. 45 by re- 
ferring to a flowchart shown in Fig. 47. 
[0319] The flowchart shown in Fig. 47 begins with a 
step SI at which the decoding apparatus 61 employed 
in the video-decoding system 51 decodes an input bit 
stream and extracts encoding parameters of the fourth 
generation, which are used for encoding the bit stream. 
The decoding apparatus 61 supplies the encoding pa- 
rameters of the fourth generation and the decoded video 
data to the history-information-multiplexing apparatus 
63. At the next step S2, the decoding apparatus 61 ex- 
tracts user_data from the input bit stream and supplies 
it to the history-decoding apparatus 62. At the next step 
S3, the history-decoding apparatus 62 extracts informa- 
tion on a combination (or descriptors) from user„data 
and uses the information for extracting encoding param- 
eters of the second and third generations received as 
history information. The history-decoding apparatus 62 
then supplies the encoding parameters to the history- 
information-multiplexing apparatus 63. 
[0320] At the next step S4, the history-information- 
rnultiplexing apparatus 63 multiplexes the encoding pa- 
rameters of the fourth, second and third generations in 
the base-band video data received from the decoding 
apparatus 61 in accordance with the formats shown in 
Figs. 7 and 11 , and supplies a result of the multiplexing 
to the history-information-separating apparatus 64. The 
current encoding parameters of the fourth generation 
were extracted at the step S1 by the decoding apparatus 
61 whereas the past encoding parameters of the second 
and third generations were extracted at the step S3 by 
the history-decoding apparatus 62. 
[0321] At the next step S5, the history-information- 
separating apparatus 64 extracts the encoding param- 
eters from the base-band video data received from the 
history-information-multiplexing apparatus 63 and se- 
lects encoding parameters most optimum for the current 
encoding process. An example of the encoding param- 
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eters most optimum for the current encoding process is 
the encoding parameters of the second generation. The 
history-information-separating apparatus 64 then sup- 
plies the most optimum encoding parameters and the 

5 descriptors to the combination-descriptor-separating 
unit 161. The history-information-separating apparatus 
64 supplies encoding parameters other than the encod- 
ing parameters determined to be most optimum this time 
to the history-encoding apparatus 65. If the encoding 

10 parameters of the second generation are determined to 
be most optimum, for example, the history-information- 
separating apparatus 64 supplies the encoding param- 
eters of the first, third and fourth generations to the his- 
tory-encoding apparatus 65. 

15 [0322] At the next step S6, the history-encoding ap- 
paratus 65 writes the encoding parameters received 
from the history-information-separating apparatus 64 in 
user_data and supplies this user_data or 
converted_history_stream ( ) to the encoding apparatus 

20 66. 

[0323] At the next step S7 ( the combination-descrip- 
tor-separating unit 161 separates the encoding param- 
eters of the second generation and the descriptors from 
the data received from the history-information-separat- 

25 jng apparatus 64, supplying the parameters to one con- 
tact point of the switch 163. On the other hand, the en- 
coding-parameter-computing unit 1 62 computes encod- 
ing parameters from the base-band video data received 
from the history-information-separating apparatus 64 

30 and supplies the computed parameters to another con- 
tact point of the switch 163. 

[0324] At the next step S8, the switch 1 63 selects ei- 
ther the encoding parameters received from the combi- 
nation-descriptor-separating unit 161 or the encoding 

35 parameters received from the encoding-parameter- 
computing unit 162 in accordance with the descriptors 
received from the combination-descriptor-separating 
unit 161, and supplies the selected parameters to the 
encoding apparatus 66. To put it in detail, the switch 163 

40 selects the encoding parameters received from the 
combination-descriptor-separating unit 161 if the pa- 
rameters are valid. If the encoding parameters received 
from the combination-descriptor-separating unit 1 61 are 
invalid, on the other hand, the switch 1 63 selects the 

45 encoding parameters received from the encoding-pa- 
rameter-computing unit 162, which computed the pa- 
rameters as a result of processing of the base-band vid- 
eo data. The encoding parameters are selected in ac- 
cordance with the capacity of the transmission media. 

50 [0325] At the next step S9, the encoding apparatus 
66 encodes the base-band video data received from the 
history-information-separating apparatus 1 05 on the ba- 
sis of the encoding parameters received from the switch 
163. 

55 [0326] At the next step S1 0, the encoding apparatus 
66 multiplexes user_data received from the history-en- 
coding apparatus 65 in the encoded bit stream and out- 
puts a result of the multiplexing before terminating the 
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processing. 

[0327] In this way, even if the combination of encoding 
parameters obtained as history information varies, 
transcoding can be carried out without : a problem. 
[0328] As described above, history information is 5 
transmitted as -history_stream ( ); a kind of the 
user_data function of the video stream, as shown in Fig. 
15. Speaking accurately, history information is transmit- 
ted as converted_history_stream : '(■). The syntax of 
history_stream"( ) is shown in Fig. , 24.The : red_:bw_flag 10 
and red__bw_jndicator descriptors, which show* a com- 
bination of history-information Items, and items*not sup- 
ported in an MPEG stream are -transmitted -as the 
re_codirig_strearh jrifo () function shown in Fig. 24. 
The items not supported in ah MPEG stream - are is 
num_other_bitSj hum_mv2:bits and num_coef_bits. 
[0329] As '" : shown'- in Fig. 48, N the. Tei;coding_ 
streanvinfo' ( ) function comprises data-eierrients^such 
as userf data_start_code,' v reIc6ding_stream_2ihfo_ID . 
red_bw_iflagr redibwlindicator;-- markerbit; : - num_ 20 
other_bits7hum£rhv_bits and num^'coef^bits. = 
[0330] The above data elements are described as fol- r 
lows. The-user_datelstart^code^ata<elemerit : is a start 
code indicating the beginning of usendata; ■•"■The 
re_codingLstream info JD data item' is a 1 6 : bit integer- 25 
used for identifying r theTeicbdingistrea"m_:info,(-)-fuhc- ' 
tio n . To '■> put , it co n cretely, r th e " va I u el' : of the" 
re_coding_stream£frifo_ID data item ;i is "1001 -0001 
1110 1100" (or0x91ec). : • 
[0331] The red_ibw_lflag data element is a 1-bifflag. 30 
When all items of the history information are transmitted, 
the flag is reset -to 0. If the ' flag 'is set at '1 p the 
red_bw_indicator data element following the flag is ex-> - 
amined'to select one of the -5 combinations-shown in* 
Fig. 46. In this way, if is possible : td determine what items* 1 '35 
have been transmitted. " 
[0332] The red_bwiindicator data -element -is a 2-bit * 
integer indicating 1 the combinations' 1 of elements ; as 
shown in Fig. 49r ' ; " »' 

[0333] To bemore specificfthe 5 combinations shown 40 
in Fig. 46 are indicated : as follows; Combination f is in- ■ 
dicated by the value of the red_bw_flag data element 
reset to 0. Oh the other hand, combinations 2 to'Sare 
indicated by the value of the red_bw_flag data element 
set at 1 .' Combinations 2; 3, 4 and 5 afeindicated by the 45 
value of the redlbwjndicator data element set at 0, 1, 
2 and 3 respectively/ i; " ' 1 " ■" • 1 .**.-■ 
[0334] ' Thus; the red _bw_indicator data element indi- 
cates one of combinations 2 to 5 only if the red_bw_flag 
data element is set- aH . - so 

[0335] In addition; in the case of combination 1 shown 
in Fig. 49 as indicated by the red_bw_flag data element 
reset to ~0, : the c marker_blt f - num_6therlbits, 
num_mv_bits and num_c'oef_bits data-elements are de- 
scribed for each macroblock. These 4 data elements are 55 
not described for combinations 2 to 5 indicated by the 
red_bw_flag data element set at 1 . 
[0336] As "shown in Fig. 36, the picture_data ( ) func- 



tion comprises one or more slice ( ) functions. In the 
case of combination 5, however, the picture_data () 
function and syntax elements below this picture_data ( ) 
function are not transmitted. In this case,: the history in- 
formation is intended for information to be transmitted 
for each picture such as .picture_type. 
[0337] In the case of combinations M to 4, the slice ( ) 
function shown in Fig. 37 exists. In thiscase, however, 
information on'the^posrtion of a. slice determined by the 
slice ( ) function and infomiation.on the position of a siice 
of the original bit-stream are dependent on the combi- 
nation of history-information items. In addition, in the 
case of combination 1 or2,:it is necessary, to have the 
same information on the position of'a slice .'determined 
by the slice ( ) function as information on the position of 
a slice of the original bit stream. ' . 
[0338] Syntax elementssof the macroblock ( ) function 
shown in Fig. 38 are dependent on :a combination of his- 
tory-information items. Syntax elements referred tto as- 
macroblock_escape and macro b I ock^ad dress ^incre- 
ment as Ave 1 1 as a macro b I ock_m odes. (•■) function, always 
exist. However/the* validity of the. macro block_escape 
and macro block_addressJncrement ^syntax ^elements 
is determined-by the combination. If the combination' of : 
history-information items is combination 1 or 2, it is nec- 
essary to transmit the same informationasskipped_mb 
of the-original bit stream; • -c-;\ , 

[0339] In the case of combination 4,- the 
motion^vector (') function does not-exist/ ln the case of 
combinations 1 to 3. on the other hand, macroblock_ 
type of the mac rob lock_imodes(:) function determines 
the existence of the motionivector: ( ) function. In the 
case of combination 3 or 4, the coded_b lock jaattern ( ) 
function ;does not. exist. In^the case of combinations or 
27 on the- dther hand, "the* macr6block_itype *of the" 
macrobldck_modes (0 function determines the -exist- 
ence of the codedjblock_pattem '( ) function. 
[0340] Syntax elements of the macroblockiimodes ( ) 
function shown in Fig. 39 are dependent on a combina-- 
tidn of history-information items. A syntax element re- 
ferred to as macroblockjype always.exists.1n the case 
of combination 4, f rame_motion_type, field_motion type 
and dct_type syntax elements do- not exist. 
[0341] The combination :of-history?information items 
determines the information validity .of parameters ;ob- • 
tained from the macroblock_type syntax element. 
[0342] 'If the combination of history-information items 
is combination 1 or -2, macrobiock_qu ant must be the , 
same as that of the original bit stream. If the combination 
of history-information items' is combination 3 or 4, on the 
other hand, macroblock_quant indicates the existence 
of quantiser_scale_code in the macroblock ( ) function 
and does not have to be the same as that of the original 
bit stream. ■-.**■ - - 

[0343] if the combination of history-information items 
is combinations 1 to 3, macroblock_motion_forward and 
macroblockjriotion_backward must be the same as 
those of the original bit stream. If the combination of his- 
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tory-information items is combination 4 or5, on the other 
hand, macroblockjnotionjorward and macroblock_ 
motion_backward do not have to be the same as those 
of the original bit stream. 

[0344] If the combination of history-information items 
is combination 1 or 2, macroblock_pattern must be the 
same as that of the original bit stream, if the combination 
of history-information Items is combination 3, 
macroblock_pattern is used for indicating the existence 
of dctjype. if the combination of history-information 
items is combination 4, the relations for combinations 1 
to 3 do not hold true. 

[0345] If the combination of history-information items 
is any one of combinations 1 to 3, maroblockjntra must 
be the same as that of the original bit stream. If the com- 
bination of history-information items is combination 4, 
on the other hand, maroblockjntra does not have to be 
the same as that of the original bit stream. 
[0346] The history_stream function shown in Fig. 24 
has a syntax for history information with a variable 
length. In the case of syntaxes for fixed lengths shown 
in Figs. 17 to 23, however, as portions of fixed-length 
history information for indicating which transmitted 
items are valid, descriptors, namely, red_bw_flag and 
redjaw Jndicator, are superposed on a base-band pic- 
ture prior to transmission. As a result, by examining the 
descriptors, is possible to determine that the contents 
of an existing field are invalid. 
[0347] Thus, as re_coding_streamJnformation, 
user„data_start_code, re_coding_streamJnfoJD 1 
red_bw Jiag, red_bw_indicator and marker_bit are pro- 
vided as shown in Fig. 21. Their meanings have been 
explained by referring to Fig. 48. 
[0348] By transmitting history information as a combi- 
nation of encoding parameters dependent on the appli- 
cation as described above, history information, which is 
dependent on the application and has a proper amount 
of data, can be transmitted. 

[0349] In transmission of history information as code 
with a variable length as described above, the 
re_coding_streamjnf o ( ) function is composed in a for- 
mat shown in Fig. 48 and transmitted as a part of the 
history_stream ( ) function as shown in Fig. 24. If history 
information is transmitted as code with a fixed length, 
on the other hand, the re_coding_stream_infomation ( ) 
function is transmitted as a part of the history_stream ( ) 
function as shown in Fig. 21. In the example shown in 
Fig. 21, as re_coding_stream_infonmation, user_data_ 
start_code, re_coding_stream_infoJD, red_bw_flag 
and red_bw_indicator are transmitted. 
[0350] In addition, a format of a Re_Coding informa- 
tion Bus macrobiock like one shown in Fig. 50 is pre- 
scribed to transmit history information in a base-band 
signal output by the history-information-multiplexing ap- 
paratus 63 employed in the transcoding system shown 
in Fig. 45. This macrobiock consists of 256 (= 1 6 X 1 6) 
bits. 32 bits on the third and fourth rows from the top of 
the macrobiock shown in Fig. 50 are picrate_element 



comprising picture-rate elements shown in Figs. 51 to 
53. On the second row from the top of the picture-rate 
elements shown in Fig. 51 , red_bw_flag with a length of 
1 bit is prescribed. On the third row from the top of the 
5 picture-rate elements shown in Fig. 51 , red_bw_indica- 
tor with a length of 3 bits is prescribed, That is to say, 
the red_bw_flag and red_bw_indicator flags are trans- 
mitted as picrate_e!ement shown in Fig. 50. 
[0351 ] Other data shown in Fig, 50 is explained as fol- 
io lows. SRIB_sync_code is a code used for indicating that 
data on the first line of the macrobiock is aligned by 
packing the data to the left end of the line. To put it con- 
cretely, the code is set at " 1 1 1 1 1 " . For a pictu re.structu re 
value of 11 indicating a frame picture structure, 
15 frJLSRIB is set at 1 to indicate that the Re_Coding in- 
formation Bus macrobiock is transmitted, exceeding 16 
fines. For a pictu re_structu re value indicating a structure 
otherthan the frameplcture structure, on the other hand, 
frJLSRIB is reset to 0 to indicate that the Re_Coding 
20 information Bus macrobiock is transmitted, exceeding 
16 lines. With this mechanism, the Re„Codlng informa- 
tion Bus macrobiock is locked spacewise and timewise 
to pixels corresponding to a decoded video frame or a 
decoded video field. 
25 [0352] SRIBJopJieldJirst is set at the same value 
as top_field_f irst held in the original bit stream and used 
for representing time alignment of Re_Coding Informa- 
tion Bus of a related video in conjunction with 
repeatjirstjield. SRIB_ repeat Jirstjield is set at the 
30 same value as repeatjirstjield held in the original bit 
stream. Contents of the Re_Coding information Bus 
macrobiock of the first field need to be repeated as in- 
dicated by this flag. 

[0353] 422_420_chroma indicates whether the origi- 
35 nal bit stream is either a 4 : 2 : 2 stream or a 4 : 2 : 0 
stream. To be more specific, a 422_420_chroma value 
reset to 0 indicates that the original bit stream is a 4 : 2 : 
0 stream. In this case, the 422_420_chroma value indi- 
cates that up-sampling of a chrominance signal is car- 
40 ried out to output a 4 : 2 : 2 video. The value of 0 indi- 
cates that a process to filter the chrominance signal is 
not carried out. 

[0354] The rolling_SRIB_mb_ref data item indicates 
16-bit modulo 65,521. The value of roliing_SRIB_ 

45 mb_ref is incremented for each macrobiock. This value 
must vary continuously over frames in the structure of 
frame pictures. If not, this value must vary continuously 
over fields. The roliing_SRIB_mb_ref data item is set at 
a predetermined value between 0 and 65,520. By doing 

so so, embedding a unique descriptor of a Re_Coding In- 
formation Bus macrobiock in a recorder system is per- 
mitted. 

[0355] Meanings of other data of the Re_Coding In- 
formation Bus macrobiock have been described above, 
55 making it unnecessary to repeat the explanation. 

[0356] As shown in Fig. 54, 256-bit data of Re_Coding 
Information Bus macrobiock shown in Fig. 50 is distrib- 
uted in bit units among LSBs of the chrominance data, 
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namely, Cb[0]fO], Cr[0][0], Cb[1][0] and Cr[1][0]. By the 
format shown in Fig. 54, 4 bits ofthe data can thus be 
transmitted. Accordingly, in orderto transmitthe 256 bits 
of the data shown in Fig. 50, it is necessary to transmit 
64 (= 256/4) pieces of data each having the format 
shown in Fig. 54. 

[0357] In the transcoding system provided by at least 
preferred embodiments of the present invention for re- 
ducing the amount of cumulative amount of picture- 
quality deterioration caused by decoding and encoding 
processes carried out as described above, encoding pa- 
rameters generated in previous encoding processes are 
recorded in VBIanking and H^blanking areas in accord- 
ance with a frequency of use of the information. Thus, 
the information can be fetched with ease when the in- 
formation is required. In addition, pieces of hardware 
can be selected in accordance with 'desired information 
or pieces of hardware can be'eliiminated if they are not 
required. 15 ^' ' ' ' ; -' ' 

[0358] In 'addition, in trietranscoding system provided 
by at least preferred embodiments of the present inven- 
tion, a synchronization code referred toas start_code is 
always written at the beginning of a packet by the video- 
decoding "system. Thus, the video-encoding system is 
capable'of restoring a lost in put packet with ease." r 
[0359] In the abovedescription; thepresentinvention 
is exemplified by : a case in which compressed encoding 
parameters are transmitted. It should be noted, howev- 
er, that' the' present 'invention can' also be applied to a 
case wherein encoding' 'parameters are transmitted 
without being compressed.' r r 
[0360] It is also worth noting that programs to be ex- 
ecuted by a computer for carrying out pieces of process- 
ing described above can - be presented- to : the -user 
througrVrietwork ' presentation media sucH as the Inter- 
net or a digital satellite to be recorded into the user's 
recording mediunrTand presented by using recording 
media such as ^magnetic disc, an optical -disc, a mag- 
netooptical disc and a semiconductor memory to be pre- 
sented to the user. •* "*■ 
[0361] In addition, steps composing each ofthe pro- 
grams presented through triemedia as described in this 
specification can of course'be pieces of processing to 
be carried sequentially one after another out along the 
time axis in accordance with a pre-prescribed order; It 
should be noted, however, that the steps do not have to 
be pieces of processing to be carried out sequentially 
along the time axis. Instead; they may include pieces of 
processing to be performed individually and concurrent- 

iy. • ••• !: 

[0362] It is also worth noting that, in thisspecification, 
the technical term "system" implies the entire apparatus 
comprising a plurality of sub-apparatuses and units: 
[0363] * In so far as the embodiments of the invention 
described above are implemented, at least in part, using 
software-controlled data processing apparatus, it will be 
appreciated that, a computer program providing such 
software control arid a storage medium by which such 
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a computer program is stored are envisaged as aspects 
of the present invention. 



Claims 

1. An information-processing apparatus for decoding 
an input encoded stream and generating an output 
signal, said information-processing apparatus com- 
prising: 

-extraction means for extracting auxiliary data 
from said input encoded stream; - 
separation means for splitting said auxiliary da- 
ta extracted by said extraction means into first 
auxiliary data and second auxiliary data; '«»-■ 
conversion means for converting said first aux- 
iliary data and said second auxiliary data, which 
were separated by said separation means, into 
'data having a predetermined format; and » 
insertion means for inserting^said first auxiliary 
data and said -second .auxiliary data, -which 
were converted by said conversion means, into 
a first position and a second position of^said 
outputsigrial respectively. ■ - 

2. An information-processing apparatus > according to 
claim 1 wherein said auxiliary data includes encod- 
ing parameters; ■■' 

3. An information-processing apparatus according to 
claim 1 wherein said first auxiliary data is inserted 
into a vertical-blankihg.area of said output signal 
and said second auxiliary data is inserted into a hor- 
izontal-blankihg^area^bf said output 'sign air- * ~ ~ 

4. An information-processing apparatus according to 
claim 1 ,-said information-processing apparatus fur- 
ther having a synch ronizatiori-co de-ad ding means 
for adding a synchronization code to the head of a 
packet of said output signal. - : : 

5. An information-processing apparatus according to 
claim 1 wherein said input encoded stream iscom- 
pressed data J and said-extraction -means 'extracts 
said auxiliary data from said compressed data. - 

6. An information-processing method adopted -by an 
information-processing apparatus for decoding an 
input encoded stream and generating an output sig- 
nal, said information-processing* method compris- 
ing: 

an- extraction step of extracting auxiliary data 
from said input encoded 'stream; 
a separation step of splitting said auxiliary data 
extracted at said extraction step into' first auxil- 
iary data and second auxiliary data; 
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a conversion step of converting said first auxil- 
iary data and said second auxiliary data, which 
were separated at said separation step, into da- 
ta having a predetermined format; and 
an insertion step of inserting said first auxiliary 
data and said second auxiliary data, which 
were converted at said conversion step, into a 
first position and a second position of said out- 
put signal respectively. 

7. A recording medium employed in an information- 
processing apparatus for decoding an input encod- 
ed stream and generating an output signal, said re- 
cording medium used for recording a program exe- 
cutable by a computer to implement a method com- 
prising: 

an extraction step of extracting auxiliary data 
from said input encoded stream; 
a separation step of splitting said auxiliary data 
extracted at said extraction step into first auxil- 
iary data and second auxiliary data; 
a conversion step of converting said first auxil- 
iary data and said second auxiliary data, which 
were separated at said separation step, into da- 
ta having a predetermined format; and 
an insertion step of inserting said first auxiliary 
data and said second auxiliary data, which 
were converted at said conversion step, into a 
first position and a second position of said out- 
put signal respectively. 

8. An information-processing apparatus for encoding 
an input signal and generating an output signal, said 
information-processing apparatus comprising: 

extraction means for extracting first auxiliary 
data or second auxiliary data, which were in- 
serted into a first position or a second position 
of said input signal respectively; 
selection means for selecting either said first 
auxiliary data or said second auxiliary data, 
which were extracted by said extraction means; 
and 

encoding means for encoding said input signal 
by utilizing said first auxiliary data or said sec- 
ond auxiliary data, which were selected by said 
selection means. 

9. An information-processing apparatus according to 
claim 8, said information-processing apparatus fur- 
ther having: 

generation means for generating third auxiliary 
data based on either said first auxiliary data or 
said second auxiliary data, which was used by 
said encoding means, as well as said first aux- 
iliary data and said second auxiliary data, which 
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were extracted by said extraction means; and 
recording means for recording said third auxil- 
iary data generated by said generation means 
into said output signal. 

5 

10. An information-processing apparatus according to 
claim 8 wherein said first auxiliary data, said second 
auxiliary data and said third auxiliary data each in- 
clude encoding parameters. 

10 

1 1 . An information-processing apparatus according to 
claim 8 wherein said extraction means extracts said 
first auxiliary data from a vertical-blanking area of 
said input signal and said second auxiliary data 

is from a horizontal-blanking area of said input signal. 

12. An information-processing apparatus according to 
claim 8, said information-processing apparatus fur- 
ther having a reproduction means, which is used for 

20 reproducing a lost portion of said input signal by re- 
ferring to the head of an input packet In case said 
lost portion is missing from said input signal. 

13. An information-processing method adopted in an 
25 information-processing apparatus for encoding an 

input signal and generating an output signal, said 
information-processing method comprising: 

an extraction step of extracting first auxiliary 
30 data or second auxiliary data, which were in- 

serted into a first position or a second position 
of said input signal respectively; 
a selection step of selecting either said first 
auxiliary data or said second auxiliary data, 
35 which were extracted at said extraction step; 

and 

an encoding step of encoding said input signal 
by utilizing said first auxiliary data or said sec- 
ond auxiliary data, which were selected at said 
40 selection step. 

14. A recording medium employed in an information- 
processing apparatus for encoding an input signal 
and generating an output signal, said recording me- 

45 dium used for recording a program executable by a 
computer to implement a method comprising: 

an extraction step of extracting first auxiliary 
data or second auxiliary data, which were in- 

50 serted into a first position or a second position 

of said input signal respectively; 
a selection step of selecting either said first 
auxiliary data or said second auxiliary data, 
which were extracted at said extraction step; 

55 and 

an encoding step of encoding said input signal 
by utilizing said first auxiliary data or said sec- 
ond auxiliary data, which were selected at said 
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selection step. 

5. An information-processing apparatus for generat- 
ing a second encoded stream from a first input en- 
coded stream and outputting said second encoded 5 
stream, said information-processing apparatus 
comprising: - ' ■* ' - 

decoding means for decoding said first input 
encoded stream; and ! ' ~ ; 10 
^generation means for ^encoding said first en- 
: coded stream -decoded -by said -decoding 
means to generate said 'second -encoded 
stream, 

^wherein:^- : ' ■ - : -' ■■' . 

said decoding means comprises: 

first extraction means 'for f extracting auxiliary 
' data'from said fi rst input encoded stream';* 1 20 
separatio^means forsplitting said auxiliary da- 
ta extracted by said first extraction means into 
first auxiliary data and second auxiliary data; 
conversion means for converting said first aux- 
iliary data'ana* said second auxiliary data, which 25 
were separated by said separatioirvmeans.Mnto 
data having a predetermined format; and" 
insertion rrieans for inserting said first-auxiliary 
data ^and -said 'second ^auxiliary ' data, 'which 
were converted by said conversion means, re- 30 
spectivejy into a first position and a second po- 
sition~of said first^en coded stream decodecf by 
said decoding : means; - ' :u ' r ' '■■ 
said decoding means decodes said first encod- 
ed stream by using said auxiliary data extracted 35 
by said first extraction means; "" ,rt * ' - 
- saidgene'ratioh^mearis comprises: ' 

second extraction means 'for extracting 
-said first auxiliary data or said seco'ndaux- 40 
iliary data respectively from said first posi- 
tion or said second position of said firsfen- 
•'■ coded:stream -decoded by said 'decoding 
' A means ; : ancT i "' ■ V; " 

selection* means for selecting either said 45 
first auxiliary data or said second auxiliary 
' data , wh ich were extracted 'by said s ecb ri d ' 
tf extraction means; and - " v - - 
said generation means encodes said first 
encoded stream decoded and supplied so 
thereto- by said decoding means by using 
' said first r auxiliary data or saidsecond aux- 
iliary data, which was selected by said se- 
lection means; to generate said second en- 
coded stream. 55 

An information -processing apparatus according to 
claim 15 wherein said first auxiliary data and said 



second auxiliary data each include encoding pa- 
rameters. 

17. An information-processing apparatus according to 
claim 15 wherein said insertion means inserts said 
first auxiliary data into a vertical-blanking area of 
said first encoded stream decoded by said decod- 
ing means and said second auxiliary data'into a hor- 
izontal-blanking "area of said first encoded stream 
decoded by said decoding means/ 

18. An information^processing ^apparatus according to 
claim 15-wherein.said decoding means-further has 
a synchronization-code-adding means for adding a 
synchronization code to the head of a packet of a 
signal output to said encoding means. 

19. An information-processing method adopted by an 
information-processing apparatus for' generating 'a' 
second encoded stream from afirst input encoded 
stream* -anb! outputting <said second encoded 
stream, said information-processing method* com- 
prising: 

a decoding step of decoding said first 1 input en- 
" coded stream; and ; ~> * --*•<"-• - 
^generation step of encodihg^said first encod- 
ed stream -decoded at said decoding step to 
generate said second encoded stream, 

wherein: r - r ' ' . - . ~ 
said decoding step comprises: 

a first "extraction sub-step of extracting auxiliary 
"data'from said first input 'encoded stream; " ' 
- a separation sub-step-of splitting said auxiliary 
" data extracted at said : f irst extraction" sub-step 

into first auxiliary data and second auxiliary da- 

-^conversion sub-step of converting said first 
'- ' auxiliary data 'arid said second auxiliary data, 
' M which were separated >at said separation sub- 
step, into data having a predetermined format; 

an insertion sub-step of inserting said firstaux- 
* iliary data and said second auxiliary data, which 
we're cbnverted.'at said cdnversionsub-step; re- 
spectively into afirstposition and^asecond po- 
sition of said first encoded -stream decoded at 
'said decoding step;* " " 

said ; deco ding step is executed to decode said 
"first ericoded ; stream by using said auxiliary da- 
ta extracted at said first extraction sub-step; 
said generation step comprises: 

a second extraction sub-step of extracting 
* said first auxiliary data or said second aux- 
iliary data respectively from said first posi- 
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tion or said second position of said first en- 
coded stream decoded at said decoding 
step; and 

a selection sub-step of selecting either said 
first auxiliary data or said second auxiliary 5 
data, which was extracted at said second 
extraction sub-step; and 
said generation step is executed to encode 
said first encoded stream decoded and 
supplied thereto at said decoding step by 10 
using said first auxiliary data or said sec- 
ond auxiliary data, which was selected at 
said selection sub-step, to generate said 
second encoded stream. 

15 

20. A recording medium employed in an information- 
processing apparatus for generating a second en- 
coded stream from a first input encoded stream and 
outputting said second encoded stream, said re- 
cording medium used for recording a program exe- 20 
cutable by a computer to implement a method com- 
prising: 

a decoding step of decoding said first input en- 
coded stream; and 25 
a generation step of encoding said first encod- 
ed stream decoded at said decoding step to 
generate said second encoded stream, 

wherein: 30 
said decoding step comprises: 

a first extraction sub-step of extracting auxiliary 
data from said first input encoded stream; 
a separation sub-step of splitting said auxiliary 35 
data extracted at said first extraction sub-step 
into first auxiliary data and second auxiliary da- 
ta; 

a conversion sub-step of converting said first 
auxiliary data and said second auxiliary data, *o 
which were separated at said separation sub- 
step, into data having a predetermined format; 
and 

an insertion sub-step of inserting said first aux- 
iliary data and said second auxiliary data, which 45 
were converted at said conversion sub-step, re- 
spectively into a first position and a second po- 
sition of said first encoded stream decoded at 
said decoding step; 

said decoding step is executed to decode said 50 
first encoded stream by using said auxiliary da- 
ta extracted at said first extraction sub-step; 
said generation step comprises: 

a second extraction sub-step of extracting ss 
said first auxiliary data or said second aux- 
iliary data respectively from said first posi- 
tion or said second position of said first en- 



coded stream decoded at said decoding 
step; and 

a selection sub-step of selecting either said 
first auxiliary data or said second auxiliary 
data, which was extracted at said second 
extraction sub-step; and 
said generation step is executed to encode 
said first encoded stream decoded and 
supplied thereto at said decoding step by 
using said first auxiliary data or said sec- 
ond auxiliary data, which was selected at 
said selection sub-step, to generate said 
second encoded stream. 

21. A decoding apparatus for decoding an encoded 
source stream, said decoding apparatus compris- 
ing: 

decoding means for decoding said encoded 
source stream in order to generate a base-band 
video signal by using encoding parameters in- 
cluded in said encoded source stream; 
vertical insertion means for inserting much re- 
quired ones among said encoding parameters 
into a vertical-blanking period of said base- 
band video signal; and 

horizontal insertion means for inserting little re- 
quired ones among said encoding parameters 
into a horizontal-blanking period of said base- 
band video signal. 

22. A decoding method adopted by a decoding appa- 
ratus for decoding an encoded source stream, said 
decoding method comprising the steps of: 

decoding said encoded source stream in order 
to generate a base-band video signal by using 
encoding parameters included in said encoded 
source stream; 

inserting much required ones among said en- 
coding parameters into a vertical-blanking pe- 
riod of said base-band video signal; and 
inserting little required ones among said encod- 
ing parameters into a horizontal-blanking peri- 
od of said base-band video signal. 

23. A decoding apparatus for decoding an encoded 
source stream, said decoding apparatus compris- 
ing: 

decoding means for decoding said encoded 
source stream in order to generate a base-band 
video signal by using encoding parameters in- 
cluded in said encoded source stream; 
vertical insertion means for inserting those of 
picture and higher layers among said encoding 
parameters into a vertical-blanking period of 
said base-band video signal; and 
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horizontal insertion means for inserting those 
of slice and lower layers among said encoding 
parameters into a horizontal-blanking period of 
said base-band video signal. 

5 

24. A decoding method adopted by a decoding appa- 
ratus for decoding an encoded source stream, said 
decoding method comprising the steps of: 

decoding said encoded source stream in order io 
to generate a base-band video signal by using 
encoding parameters included in said encoded 
source stream; 

inserting those of picture and higher layers 
among said encoding parameters into a verti- 15 
cal-blanking period of said base-band video 
signal; and 

inserting those of slice and lower layers among 
said encoding parameters into a horizontal- 
blanking period of said base-band video signal. 20 

25. A decoding apparatus for decoding an encoded 
source stream, said decoding apparatus compris- 
ing: 

25 

decoding means for decoding said encoded 
source stream in order to generate a base-band 
video signal by using encoding parameters in- 
cluded in said encoded source stream; 
vertical insertion means for inserting general 30 
ones among said encoding parameters into a 
vertical-blanking period of said base-band vid- 
eo signal; and 

horizontal insertion means for inserting de- 
tailed ones among said encoding parameters 35 
into a horizontal-blanking period of said base- 
band video signal. 

26. A decoding method adopted by a decoding appa- 
ratus for decoding an encoded source stream, said 40 
decoding method comprising the steps of: 

decoding said encoded source stream in order 
to generate a base-band video signal by using 
encoding parameters included in said encoded *s 
source stream; 

inserting general ones among said encoding 
parameters into a vertical-blanking period of 
said base-band video signal; and 
inserting detailed ones among said encoding so 
parameters into a horizontal-blanking period of 
said base-band video signal. 

27. An encoding apparatus for encoding a base-band 
video signal, said encoding apparatus comprising: 55 

extraction means for extracting much required 
encoding parameters from a vertical blanking 



period of said base-band video signal and little 
required encoding parameters from a horizon- 
tal blanking period of said base-band video sig- 
nal; and 

re-encoding means for re-encoding said base- 
band video signal by referring to said much re- 
quired encoding parameters and said little re- 
quired encoding parameters. 

28. An encoding method adopted in an encoding appa- 
ratus for encoding a base-band video signal, said 
encoding method comprising the steps of: 

extracting much required encoding parameters 
from a vertical blanking* period of* said base- 
band video signal and -little required encoding 
parameters from a horizontal blanking period of 
said base-band video signal; and 
re-encoding said base-band video signal by re- 
ferring to-said much-required encoding param- 
eters and said little required encoding parame- 
ters. 

29. An encoding apparatus for encoding a base-band 
video signal, said encoding apparatus comprising: 

extraction means for extracting encoding pa- 
rameters of picture and higher layers from a 
vertical blanking period of said base-band vid- 
eo signal and encoding parameters of slice and 
lower layers from a horizontal blanking period 
of said base-band video signal; and 
re-encoding means for re-encoding said base- 
band video signal by referring to said encoding 
parameters' of picture and higher layers and 
said encoding parameters of slice and lower 
layers. 

30. An encoding method adopted in an encoding appa- 
ratus for encoding a base-band video signal, said 
encoding method comprising the steps of: 

extracting encoding parameters of picture and 
higher layers from a vertical blanking period of 
said base-band video signal and encoding pa- 
rameters of slice and lower layers from a hori- 
zontal blanking period of said base-band video 
signal; and 

re-encoding said base-band video signal by re- 
ferring to said encoding parameters of picture 
and higher layers and said encoding parame- 
ters of slice and lower layers. 

31. An encoding apparatus for encoding a base-band 
video signal, said encoding apparatus comprising: 

extraction means for extracting general encod- 
ing parameters from a vertical blanking period 
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of said base-band video signal and detailed en- 
coding parameters from a horizontal blanking 
period of said base-band video signal; and 
re-encoding means for re-encoding said base- 
band video signal by referring to said general 5 
encoding parameters and said detailed encod- 
ing parameters. 

32. An encoding method adopted in an encoding appa- 
ratus for encoding a base-band video signal, said w 
encoding method comprising the steps of: 

extracting general encoding parameters from a 
vertical blanking period of said base-band vid- 
eo signal and detailed encoding parameters is 
from a horizontal blanking period of said base- 
band video signal; and 

re-encoding said base-band video signal by re- 
ferring to said general encoding parameters 
and said detailed encoding parameters. 20 
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F I 6.15 



stream with history data 



video_sequence ( M 


No. of bits 


Mnemonic 


next_start_code ( ) 






sequence header ( ) . .. - 






sequence_extension( ) ~\ 






do{ - 






extensi on_and_user_data (0) 






do{ ^ : ; , 






if (nextb its( ).= group_start_code) { r: - 






g roup_of jp i ctures_heade r (1 ), 






- e xt ens i onjand^use rjclata ( 1 ) 






} _ „ - . _ . ... 






pi'cture_header (,)--■;- 






picture_coding^extensi pn ( ;) ■ > ; 






wh i I e ( (nextb i ts ( )~extens"i:onjstart_code) II * 






(nextb its ( ) ^ujsef^datajstart^code) ) i{ 






i f (nextb f ts ( ) =extens i bn.star t.code)") 


wit, , 




extens i orncteta (2) ~~ 






i f Cnextb.i ts ( )™user_;data_start_code) { 


,' ■ 




user_data_start_code - . ■ - 


32' 


bslbf 


if (nextbitsC )=Hi storyiData_ID) [ 






HistoryJhitaJD ? . 


32 


. bslbf 


•converted^hi story^streamt') >-^ ^v 






) ■: % •: ■ 






el se{ ■ . :.v- 






user_data( r -™ - r 






] ■ 






/ - . ... 












Dieture data( ) *-* : -" "'v 






} whi le ((nextbi ts ( )==pi;ctur;e_start_code), II 






(nextbi ts( )==grouplstart_code)) • 






if (nextb its ( ) !=sequence_end-code) { 






sequence_header ( ) 






sequence_extension( ) 






} 






} whi 1 e (nextb its(.) !=sequence_end_code) 






sequence_end_code 


32 


bslbf 
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F I G.I 7 



history stream (17-1.) . 



history_;stream( ) {- bits - 


...value 


sequence_header - . ■ 








■ 32 


00000 1B3 


sequence_header_present_f lag - 


- -A- 


-. . . ^ V— - : 


horizontal_size_value - ■ ■ ■ - • - 


H2 




-marker :b it ; ~ * — - - - 


• - 1 


, -1 : 


verticaLsize_value~ - - - - - 






aspect.ratioli nforfnat ion' ' 


: "; /;'' ' 4-, 




f rame_ra"telcbde "*~ * ' " " ** ■ 




„ m .,7~^ 


maker^b i t " " ~' " " ' ~ * ;:: 


t : .1. • 


r 


b i t_rate_value 


;;■ is 




~marker_bit , ,., . 


^ ■'-,'. r .h': 


■■■ 1 


,vbvj>uffer_$ize_value 


1.0 




'const rained_iparameter_f l ag 


r.,1 . 


0 


load_intra_,quant iser_matri x ■ . 


-1. 




1 oad_non_ i nt ra_quan t i se rjnat r i x 


1. r 




makervb i ts_ „ ; _ 


.„ , -5 - 


.. ... 1.F., 


:j'ntra.quantiser_matrix.[64] 


8*64:... 




• non J,nt ra-quaat use r jnatrj x[64]^ „ : 


,„ 8*64 


_ 


- ^ . _ _ ; 




V> ■«■»»- 


sequence^extension — . . . , ; . , 




- 


iextens ion start -code 


- 32 


000001 B5 - 


fextens ion_start-code_i dent i tier 


4. 


- ' 1 • 


sequence_extensionjpresent^f lag 


- -1- 


■■ 


,pr of i 1 e_andH e ve 1 1 i nd i ca t i on 


- 8- 




progress iveisequence 


- 1 - 




chroma_fbrmat "** - - - /; 


-;2 




hor i zonta l_s i 2is3x'tens i oh "" 






vert icaLsizelextensi on' 


2 . 




marker_bit 


1 




bit_rate_extension 


12 . 




vbv_buf f er_s i ze_extens i on 


8 " 




low_delay 


•1 




markerjb:it 


1 


1 
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history stream(17-2) 





bits 


val ue 


frame rate extension_n 


o 
C 


frame rate extens ion_d 


c 
0 




marker_bit$ 


6 


3F 








sequenced i sp 1 ay.extens i on 






extens i on_start_code 


32 


000001 65 


extens i on_start_code_ i dent i f i e r 


4 


2 


sequenced i sp 1 ay_extens i on_present_f 1 ag 


1 




video_format 


3 




co!our_descr iption 


1 




co lou ^primaries 


8 




t ransf er ^character i st i cs 


8 




marker_bit 


1 


1 


matrix_coeff icients 


8 




d i sp 1 ay_hor i 2onta 1 _s i ze 


14 




marker_bi t 


1 


1 


d i sp 1 ay_ve rt i ca 1 _s i ze 


14 




marker_bi t 


1 


1 








mac rob 1 ock_ass i gnment_i n_user_data 






macrob 1 ock_ass i gnment_pre$ent_f 1 ag 


I 




marker_bit 


7 


7F 


v_phase 


0 
O 




h phase 


0 

0 










9» oup_or_p i ct ure^/ieaucr 






group_start_code 


32 


000001 B8 


g r oup„of _p i c t u r e_head e r_p res en t_f 1 ag 


1 




t i me_code 


25 




closed gop 


1 




broken 1 ink 


1 




marker bits 


4 


F 








picture_header 






picture_start_code 


32 


00000100 
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history stream (17-3) 



I bits 


value 


tempora I _ reference 


"10 




picture codina tvDe 


. - - *3 




marker b i t 


1 

1 


1 


vbv de lav 


* 1fi 

•10" 




TIJ I ! iDP I Tfirwar^ v/or*^r\r "* " 
■ Ui l _JVCI III i Itdi 0_Vcu LOT 


■ - j 


- - 


■forward "f r*nrl o - 


-■• ■ o 




Till 1 rkA.I nQrvWQ rn \<Q/*rnr " ' ■* . . . 

1 ui i __pc*i _DacKwciro vector 


; . - * 1 


— i_ 


marker k i ¥ <' - **. 


■ - - , i 
- — 1 - 


II 


nSPKHIA Tn -T* r* orl o 






ma rlcpr k I f* * * . <\ 


i * 1 - 


1 








di cruris codina pyfonc inn 






* extension *s1"Arf rndp > v "v " 




000001 B5 


extension 'S'Tarf rnrlp iriAnfif ipr 




8 1 


v 'f codefO] [01 






f code[0] Fl] . 






f code[1][0] 






' f code [1 ] [1] 


■4 - 




intra_dc_prec'ision 1 • 1 '* 




' •*''■- l 


picture.structure 


2 




top_f ield_f i rst 


r- y... 




^ frame vpred^f ramejdct 






conceal ment_mot ion_vectors • ~ l 


• -i. • 




q_scalejtype . " ^ 






marker_bi t 


:•• 1 - 




intra_vlc_format 


■-.•^ 1 ■ 




al ternate_scan 


r - K 




repeat_f i rst_f ieid 


1 • 




chroma_420_type 






progressi ve_f rame 


1 . 




• compos i te_d i-sp 1 ay_f 1 ag 


•• '..•1 




v_ax i s 


1 




f ield_sequence 


• ..3 ' 




sub_carrier- 


.1'. 




burst_ampl i tude | 7 
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history stream (17-4) 





bits 


value 


marker_bi ts 


1 


1 


sub_carr i er_phase 


8 










quant jnat r i x_extens i on 






extens i on_start_code 


32 


00000185 


extens i on_s tart_code_ i dent i f i er 


4 


3 


quantjnatr i x_extens i on_present_f I ag 


1 




1 oad_ i ntra_quant i serjnatr i x 


1 




marker_bi ts 


2 


3 


i nt ra quant i ser jnat r i x [64] 


8*64 




1 oad_non_ i nt ra_quant i ser jnat r i x 


1 




marker_bi ts 


7 


7F 


nonj ntra quant i ser jnat r i x [64] 


8*64 




1 oad_chroma_i ntra_quant i ser jnat r i x 


1 




marker J> its 


7 


7F 


chormaj nt ra_quant i ser jnatr i x [64] 


8*64 




1 oad_chroma_non_i ntra„quant i ser jnat r i x 


1 




marker J> its 


7 


7F 


chroma ju>n_i ntra_quant i ser jnat r i x [64] 


8*64 










copyright_extension 






extens i on_start_code 


32 


000001 B5 


extens i on_start j:ode_ i dent i f i er 


4 


4 


copy r i ght_extens i on_present_f 1 ag 


1 




copynght_f lag 


1 




wupy r i yni_i pent i t i er 


0 

o 




original_or_copy 


1 




marker_bit 


1 




copyright_number_1 


20 




marker_bit 


1 




copyright_number_2 


22 




marker_bit 


1 




copyright_number_3 


22 


3F 


marker_bits 


6 











63 



EP1 111 932 A2 



F I G.21 



history stream (17—5) 



■-■ — — ■ " 


- bits 


value • ■ 


p i cture_d i sp lay_extens i on 




« . » . 


extens i on_start_code 


32 


000001 B5 


extens i on_start_code_ i dent i f i er 


• 4 


• 7 


picture_display_extension_present flag 


• - 1 




:frame.centre.hori2bntarof fset^l 


16 


/- ~ 


— .narker_bit - — - ~ , ■ ~ ~ 


- ---t 




~ .iran»e_centre_vert'ical_offset-4 - 


- 16- 




markerjbit _ _ 


T .. 




frame_centre.hori2ontal.off set 2 


' 16 




marker_brt 


1 




f rame_centre_vert ica'Lof f set_2 


16 




- marker_bit * — ~ ** . 


" 1 




- - frame_centre_horizontal_offset -3—— — 


-•16 




. -.-marker_bit— - ~ . ~. -~ ™ . 


■ — 1 


• i : 


frame_centre vertical offset 3 


-16 




marker.bht . v 


- . .6 




■' f - 






re.cod ing_stream_i nf ormat i on 






?~~v user^data.startlcbde^ * ~ ~ 


"" 32 ' 


000001 B2 


re_coding_streajn_'info_ID ^ - — 


J 16 ■ 


- ^^ 91 EC - 


: ^ redjw_flag ~. — .. , 


- - -1- 




red_bw_indicator .. . v. . /. 


.2 : 




maker_bit 


5 




■ 






. user_data 






"userjdata.start^code" ~* - - ■ - - 


32 ; 


0OO0G1B2 


- -user_data--~ - ~ , f ~ - - 


• 2048" 


.. — : ~ — 




-~ - ; - ' ■ 


--- - -• 


whi le (mac rob lock i=macroblock_count).{ .. . . 




— " 


mac rob lock 






mac rob 1 ock_add ressjh 


8 




mac rob lock address »v 


0 . 
0 




""" sltcelheadef'Jpresen'r'f 1 ag • " 7" " 


" : • " r ' 




'- — -"-skipped.macroblock^f lag - - 


— - 1 - 




markerjbit — . 


■i 










nacroblock_modes(.) 






*macroblock_quant 


1 




mac rob 1 ock_mot i on_f orward 


i 




mac rob 1 ockjnot i on_b"ackward 


1 . 




•macroblockipattern — ~ 


r ' 




. . mac rob lock_- intra -«.■».. - ... - - 


1 
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history stream (17-6) 





bits 


val ue 


spat i a 1 _tempora 1 _we i ght_code_f 1 ag 


1 




f ramejnot ion_type 


2 




f ieldjnot ion_type 


2 




dct_type 


1 




marker_bits 


2 


3 








quant i ser_sca 1 encode 


5 




marker_bi ts 


3 


7 








PMV[0] [0] [0] 


14 




marker _b its 


2 


3 


PMV[0] [0] [1] 


14 




mot ion„vert i ca l_f i e 1 d_se 1 ect [0] [0] 


1 




marker_bit 


1 


1 


PMV[0][1][0] 


14 




marker_bits 


2 


3 


PMV[0][1][1] 


14 




mot i on_vert i ca l_f i e 1 d_se 1 ect [0J [ U 


1 




marker_bi t 


1 


1 


PMVL1J [0] [0] 


14 




marker_bi ts 


2 


3 


rMVLlJ LUJ LI J 


14 




mot i on_ve rt i ca 1 _t i e 1 o_se f ect L 1 J LUJ 


I 




marKer_D i t 


1 


i 
i 


puvrnrnrm 

rMVL I J u J LUJ 


1 A 




marker bits 


2 


3 


pMvmmm 


14 




motion_vertical_f ield_select[1] [1] 


1 




marker_bit 


1 


1 








coded_b 1 ock_pattern 


12 




marker_bits 


4 


F 


num_mv_b i ts 


8 




num_coef_bits 


14 




niarker_bits 


2 


3 
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history stream (17-7) 





bits 


value 


num_other_bits • ' 


7 




marker_bit 


1 


1 


} 








hi story -stream — 


No.of -bi ts 


Mnemonic* 


: • next^start-code ( ) ~ . 






— sequence Jieader-( ) - ^ — - .-J 






sequence^extens i ■on^)--^- ^^^.vw^ 






-extension^and^jser^datalO)- ~ " 






— — i f~(nextb i ts ( ~) == group_start_code) 1 












... extens i on_and- user^data (T)^ - - -. 












\ - pkture_header-( <)- ......... 






— picture^coding^extens ion(-) , 






re_coding_stream_info( ) 






extens i ons_and_user_data (2) 






picture_data( ) 






sequence end code 


32 


bslbf 


} 
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sepuence^header ( ){ 


No* of bits 


Mneroon i c 


sequence_header_code 


32 


bslbf 


ho r i zonta I _s i ze_va I ue 


12 


uimsbf 


verticaLsize_value 


12 


uimsbf 


aspect.rat i o_ i n f o rma t i on 


4 


uimsbf 


f rame_rate_code 


4 


uimsbf 


b i t_rate_va I ue 


18 


uimsbf 


marker_bit 


1 


bslbf 


vbv_buf f er_s i ze_va I ue 


10 


uimsbf 


constrained_parameters_f lag 


1 


bslbf 


I oad_ i nt ra_quan t i se rjnat r i x 


1 


uimsbf 


i f ( I oad_ i ntra_quant i se rjnatr i x) 






i nt ra_quan t i se r jnat r i x [64] 


8*64 


uimsbf 


I oad_non_ i nt ra_quant i se r_mat r i x 


1 


uimsbf 


i f ( I oad_noru i n t r a_q uan t i s e r_mat r i x) 






non_i nt ra_quant i serjnatr i x [64] 


8*64 


uimsbf 


next start code( ) 






} 
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sequence_extens i on ( ){ 


No. of bits 


Mnemonic 


extens i on_start_code 




bslbf 


extens i on_start_code_ i dent i f i er 


A 

4 


uimsbf 


prof 1 1 e_and_l eve 1 _i nd i cat i on 


8 


uimsbf 


progress ive.sequence 


'I - 


" -uimsbf * 


chfoma_f onnat f *~ f 




"ui msbr 


hori2ontal2s ize_extensi on ' ^ v ^ 




^uimsbf u - 


vertJcalIsi2e_extensiori * 


... -~-. 2 --- 


^uimsbf 


b i t_ratelextehs ion " ' ^ 


-12 


' u inisbf 


markerjnt '~ ~ ^ ~ 




- - bs 1 bf ; 


' vbv.bufferrs izelextension " ~ ~ 




^uimsbf 


ioiCdelay ^ - - - — — - — 


- — r 


-ui msbf 1 ^ 


f rame_rate_extens i on_n 


2 


uimsbf 


f rame_rate_ex tens i on_d 


5 


uimsbf 


next_start code( ) 






} 







extens J on_ari3_user_data ( i.) { - . . 


No: of* bits * 


•Mnembnic 


wKTI-e ( (nextBTits ( "*) "—extens i onls t a rt _cbcle) * H ~' " " 






" (n^extbitsl')'=userldaTaJstartl"code))*{ * 






if ( ( i =2) &£(nextB its'D =extens i ofTstartrcode)")"* 






extens ion^data(i) * " 






if (nextbits( )==userjJata_start_code) 






user data( ) 






} 






} 
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user_data( ) { 


No. of bits 


Mnemon i c 


user_data_s ta rt^code 


32 


bslbf 


*hile(nextbits()!= '0000 0000 0000 0000 0000 0001' ){ 






user_data( ) 


6 


uimsbf 


} 






next_start_code ( ) 






} 







F I G.29 



group_of_pictures_header ( ){ 


No. of bits 


Mnemon i c 


group_start_code 


32 


bslbf 


tine.code 


25 


bslbf 


closed_gop 


1 


uimsbf 


broken J ink 


1 


uimsbf 


next start code( ) 






} 
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r~ ;,r x__ IT FIG . 3 0 - 

■ ■ ; . : v.; ; ...... . 

• — 4 - . ■ - ;*-,. - .---v -' 


(i * - • ■ • * 

.. ...... 


7 v~ 

;- f'. ' 


pictur.ejheaderj ) -L ; — 


No. of bits 


Mnemon i c 

■ •It Will VI 1 1 W 


picture_start_code_ y L. r ?L-* 


■ \ 32 


Lbs : PbT _ 


tempera preference _ 1 /" 


10- 


u imsbf^ 


_ pi cture_cod i ng_type 


•wt^ 3. 


: Qu ints bf ' 


vbv_de 1 ay 


5 , 16 


f u imsbf 


, Jl (picture_coding_type=^2 II picture.cod i ng_type=3) { 






i_ ^Mlj-J>e Ijf orwaccLvectpr 




bsibf 


L forward f code 




' bslbf 


• . ... _ 






Li f : (p i cture_cod i ng_type=f3) .{ 






_ r f iij 1 ^j>e 1 f p rward_vec to r 




. bslbf 


, -i ; ^backward^f^code : . 




...bstbf .. 








:.whi:le;(ne _ 






L extra^Ltjicture/^wiih ..the. value JY 




uimsbf 


.. extra^ information picture. 


■h. : 1 is; 


'•uimsbf 


^ . , : _ 






extra^bi,t_p.i:cture/*with the value '0'*/ 


. ■ "•' ' ■ 1 


uimsbf 


nextistar:t_codei „) 










■ 1 ' r 



70 



EP1 111 932 A2 



F I G.31 



Dinture codina extension! ) t 


No. of b i ts 


Mnemon i c 


extension start code 


32 


bslbf 


pyfpnsinn <stfirt code identifier 


4 


u i msbf 


f rode TOl FOl /^forward horizontal*/ 


4 


u i msbf 


f code TOl m /*forward vertical*/ 


4 


u i msbf 


f code Ml TOl /^backward horizontal*/ 


4 


u i msbf 


f code [11 ni /*backward vertical*/ 


4 


u imsbf 


intra dc orec is ion 


2 


u i msbf 


olcture structure 


2 


u i msbf 

\d 1 III w W 1 


too field f i rst 




u i msbf 


frame Dred frame dct 


1 


u imsbf 


concealment motion vectors 


1 


uimsbf 


d_sca 1 e_type 


1 


uimsbf 


i nt ra_v 1 c_f o rmat 


1 


uimsbf 


alternate.scan 


1 


uimsbf 


repeat_f irstjf ield 


1 


uimsbf 


chroma_420_type 




uimsbf 


progress ive_f rame 




uimsbf 


compos i te_d i sp lay.f 1 ag 




uimsbf 


i f (compos i te_d i sp 1 ay_f 1 ag) { 






v_ax i s 




uimsbf 


f leld_sequence 




uimsbf 


sub_carrier 




uimsbf 


burst_ampl itude 


7 


uimsbf 


sub carrier phase 


8 


uimsbf 


} 






next start_code() 






} 
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F I G. 32 



extension_data ( ) { 


No. of bits 


Mnpmnn i r 

mi I C|| ILf I | | 


wh i I e (nextb i ts ( . ) — extens i on_start_code) { 






exterisiori^start-code " 


~ - -32-" 


Uo LOT 


_r' if (ir=0)/*fol lows sequence_extens ion ( )*/~" 






sequence_drsplay_extension(*0 — "* 






/* NOTE-i never takes the 7 va I ue**1 because -extension data ( i 


■ . : 




7 - never fol loirs-a-group-of pictures header( ■)*/- 


... 




- --if ( i=2)/*f o 1 1 ows-p i ct ure^cod i ng^extens i on ( ) V — 






— if (nextb its(,)==~"Guant Matrix Extension -ID"). 






'.'Jz ^ quant matrixjextensionX ) ... _ 






,.. el se; if (nextbi ts.( J ~ "Copyright Extension iD") 






A .L»J.copxn.gh^extens.io.n( )„. 






; f else 






"*.' picture_di,splay extens ion ( ) 












} 


■ - , I 





F I G. 33 



quant_matrix_extension( ) { 


No. of bits 


Mnemonic 


extens i on_start_code_ i dent i f i er 


4 


uimsbf 


1 oad_ i-nt ra_quan t i se r_mat r i x 


1 


uimsbf 


. i f ( 1 oadl in- 1 ra^q uant i se r_ma t r i x) 






inthaiquantiser^matrix [64] ~ 


- -r: 8*64 


" uimsbf ; 


load3on_Tntra_quantlserimatrix 


- •• - 1 • 


"uimsbf " 


Tf(load_nonH'ntra_quantis^ : 






w - ; -non J nt ra-quant i ser_matri x [64] • - 


• 8*64 .- 


r : uimsbf 


load.chrona^intra^quantiser^matrix - 


- •• 4~ 


- u i msbf - 


- 'if doad_chromaj-ntra_quantiser matrix) 






<; chromajntra.quan^ 


8*64.- 


u imsbf 


, -J.oad^chroma_non.j ntta_quant iserjnatr i x 


1 


uimsbf^. 


if (load_chroma_non_intra quantiser matrix) 






chroma_non_intra_quantiser_matrix [64] 


8*64 


uimsbf 


next start code( ) 






} • 
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F I G. 34 



copyr ight_extensi on ( ){ 


Kin nf kife 
(NO. OT DICS 


Mnemon I c 


extens i on__sta rt_code_ i dent i f i er 


A 


u ifnsbf 


copyright_f lag 


1 

1 


bsl bt 


copyr i gn t_ i oen t i r i er 


8 


m i mchf 

U 1 IIIO U 1 


original_or_copy 


1 


bslbf 


reserved 


7 


uimsbf 


markerj>it 


1 


bslbf 


copyr i ght_nuniber_1 


20 


uimsbf 


marker J> it 


1 


bslbf 


copyr i ght_number_2 


22 


uimsbf 


marker _b it 


1 


bslbf 


copyright_number_3 


22 


uimsbf 


next_start_code ( ) 






} 







F I G. 35 



picture_display_extension( ){ 


No. of bits 


Mnemonic 


extens i on_start_code_ i dent i f i er 


4 


uimsbf 


f or (i=0; i ;number_of_f rame_centre_of fsetsl { 






f rame_cen t rejior i zonta 1 _of f se t 


16 


simsbf 


marker_bit 


1 


bslbf 


f rame_cent re_vert i ca 1 _of f set 


16 


simsbf 


markerjw t 


1 


bslbf 


} 






next_start_code( ) 






} 
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picture_data() { 


No. of bits 


Mnemoni c 


do{ * * : 






si ice 0 - 






}whi l e (nextbi ts()=sl ice_start_code) 






.next^stari^code () _ _ 













slice ( ) { w. ; 


No. of bits 


'Mnemonic 




slice_start_code - !' ',. , f 


- - -32 


t, bs.l.bf 




; sl ice_'quant i ser_sca I encode J 


- - --.. : 5: 


uimsbf 




. if (nextbi-tc )= T){ ■ 


* / ■ \? . -"-* 1 ,; ' 






intra_sl icelf lag 








V intrajsl ice * . 


... / 1 : 


-■ ojimsbf ; 




* reserved_b i ts 


•7; 


uimsbf 




; whil e (nextbifs ( ) == T ) { 








ext raj> i t_s lice /*w i f ti the val ue V */ 




• .uimsbf : 




extra_informat ion slice 


.... . -.g. 


r uimsbf 




} •■ • • :ry , 
















extra_bit_sl ice/'with the" value "'0'*/ 


r 


uimsbf 




do{ 








macroblock( ) 








}while(nextbit( )N '000 0000 0000 0000 0000 0000') 








next start code( ) 








} 
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mac rob I ock ( ) f 


No. of bits 


Mnemon i c 


whi le(nextbits( )*= '0000 0001 000') 






mac rob 1 ock_escape 


11 


bslbf 


mac rob lock_address_ increment 


1-11 


vlclbf 


mac rob 1 ock_modes ( ) 






i f (mac rob 1 ock_quant) 






mac rob 1 ock_quan t i se r_sca 1 encode 


5 


uimsbf 


if (IredJwLf lag II 






(redJwJMag tt(red bw indicator^!))) { 






i f (macroblockjnot ion_f orward II 






(mac rob I ock_ intra 11 concealinentjnotionj/ectors)) 






motion_vectors (0) 






i f (mac rob 1 ockjnot i on_backward) 






motion_vectors(1) 






if (macroblockjntra 44 conceal mentjnotion_vectors) 






markerj>it 


1 


bslbf 


} 






if (macroblock_pattern && 






(!redj>w_flag II 






(redjwj I ag && (red.bwj nd i cator— 0) ) ) 






coded block pattern ( ) 






} 
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F | G..39 



mac rob l ock mode<;( ) I 


111"../ Lli- 
NO. OT b 1 tS 


Mnemon i c 


mac rob l ock fvne ' " 


r • • ::• 1 ~3 


* vie I bf 


'■' ' \ " 1 Vp» U Ft 1 | II A 






* i(red bw f laa frecl 'bw' i! nrl i '*ck¥ nr;< 1 VV.V I 






i f (mac rob I ock mot i on forward II 






mac rbb 1 ockf mot i on 'hflrkwarrO f 






• i f (p i.cture_structu're== 'frame' ) { 


--- 


. .. . 


— "~ Vf (frame J>red J rmeZ<ict==Q)' ""' 






f rame_mot i on_type 


2 


uimsbf 


}else{ 






f ield_motion type 


2 


uimsbf 


} • - ; 






} 






• } * '• - - • • ■■ 






i'f *(-(pi cturelstr.uct u re==" " Frame" *P i ctur"e") " 






r-:»(fraimelprea^rame_dct===0)&&- — ~" v 


■f ■ ' . v " . 




~ (dctltypelf 1 ag=t)"&&~ - ; • ■ - 


...... .-^^ 




— (l-nedlbOtag- II ~ . 






~" ^ 1red_brf tag lfr(red:bw:indicator<1))')') (• 






■ dctltype --. - - — 


; 1: 


"u.i msbf 
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mot ion_vectors (s) { 


No. of bits 


Mnemonic 


i f (mot i on_vector_count~1 ) { 






i f ( (mv_f ormat==f i e I d) && (dmv ! =1 ) 






mot i on_vert i ca Lf i e I d_se I ect [0] [s] 


1 


uimsbf 


mot ion_vector (0, s) 






} e I se { 






mot ion_ vert ical.f iel deselect [0] [s] 


1 


uimsbf 


motion.vector (0, s) 






mot ion_vertical_f iel deselect [1] [s] 


1 


uimsbf 


motion vector (1,s) 






} 






} 







F I G.41 



mot ion_vectors (r, s) { 


No. of bits 


Mnemon i c 


motion_code[r] [s] [0] 


1-11 


vlclbf 


if ((f_code[s] [0] !=1)&t(mot ion_code[r] [s] [0] !=0)) 






mot ion_resi dual [r] [s] [0] 


1-8 


uimsbf 


if (dmv=1) 






dmvector[0] 


1-2 


vlclbf 


motion_code[r] [s] [1] 


1-11 


vlclbf 


i f (f.code [s] [1 ] !=1 ) && (mot i on.code [r] [s] [1 ] !=0) ) 






mot ion_resi dual [r] [s] [1] 


1-8 


u i msbf 


if (dmv==1) 






dmvector[1] 


1-2 


vlclbf 


} 
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macroblock_type 


V LC 


code 




macroblock_quant 






dct_type_f 1 ag 








mac rob 1 ockjnot i.on_f orward 










mac rob lockjnot i on_backward 












Description 


1 


0' 


1 


0 


0 


.,">• Intra • ' ■' . 


01 


1" 


1 


0 


0. 


x Intra, Quant 



macroblocKI^ty 


pe" 


VLC" code — « 




macr.ob 1 ockiquant — . - - 






dct-type^f lag f-~~ - — -j 


* 






mac rob I ock^mo^i on^f orward -. . 










macrob I ock^-motii on-backward 












Description- ■ 


1 • 


10* 


'1 " 


1 


0" 


- """MC Goded • 


01 


0 


1 


0 


0 


No MC, Coded 


001 


0 


0 


0 


0 


MC, Not Coded 


0001 1 


0 


1 


0 


0 


Intra 


0001 0 


1 


1 


1 


0 


MC, Coded, Quant 


0000 1 


1 


1 


0 


0 


No MC. Coded, Quant 


0000 01 


1 


1 


0 


0 


Intra, Quant 



78 



EP 1 111 932 A2 



FIG. 44 



macroblock_type 


V LC 


code 




macroblock_quant 






dct_type_f lag 








mac rob 1 ock_mot i on_f orward 










mac rob I oc kjnot i on_bac k wa r d 












Description 


1 0 


0 


0 


0 


0 


Interp, Not Coded 


1 1 


0 


1 


1 


1 


Interp, Coded 


010 


0 


0 


0 


0 


Bwd.Not Coded 


on 


0 


1 


0 


1 


Bwd, Coded 


0010 


0 


0 


0 


0 


Fwd. Not Coded 


001 1 


0 


1 


1 


0 


Fwd. Coded 


0001 1 


0 


1 


0 


0 


Intra 


0001 0 


1 


1 


1 


1 


Interp, Coded, Quant 


0000 1 1 


1 


1 


1 


0 


Fwd, Coded, Quant 


0000 10 


1 


1 


0 


1 


Bwd, Coded, Quant 


0000 01 


1 


1 


0 


0 


Intra, Quant 
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F I G. 46 



COMBINATIONS OF 


HISTORY- 


-INFORMATION ITEMS 




num_ 


coef_b 


its 


num_mv_bi 


ts, num 


_other_b i ts 






q. 


.scale. 


code, q 


_scale. 


.type 










mot i on_type, mv_vert_f i e I d_se I [] [] . mv [] [] [] 










mb_mf wd, mbjnbwd 












mb 


_pattern 




















coded_b 1 ock_pattern 
















mb_intra 


















si 


ice 


.start 




















dct_type 






















mb 


_quant 
























sk i pped_mb 


COMBINATION 1 


2 


2 


2 


2 


2 


2 


2 


2 


2 


2 


2 


COMBINATION 2 


0 


2 


2 


2 


2 


2 


2 


2 


2 


2 


2 


COMBINATION 3 


0 


2 


2 


2 


2 


0 


2 


1 


2 


1 


1 


COMBINATION 4 


0 


2 


0 


1 


1 


0 


1 


1 


0 


1 


1 


COMBINATION 5 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 


0 



COMBINATIONS OF HISTORY-INFORMATION ITEMS 
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( START ) 



DECODE' A BIT STREAM AND""..: 
RETCH ENCODING 'PARAMETERS 



SI 



EXTRACT user.data S2 



-DECODE- userdata-rAND 'FETCH- 
ENCODING -PARAMETERS; 



S3 



■MULTIPLEX THE ENCODING PARAMETER'S 
IN-THE~DECODED BASE- BAND SIGNAL—- 



S4. 



SELECT ENCODING PARAMETERS 
MOST OPTIMUM FOR REENCO DING" 



S5 



INCLUDE THE REMAINING ENCODING 
PARAMETERS I N user data 



S6 



SEPARATE DESCRIPTOR Si S7 



S E L ECT - V All D BNCODING-rP AR AM ETE R S 
INDICATED BY THE DESCRIPTORS ^ ; : ; 



38 



PERFORM.-ENCODING BASED ON, THE 
SELECTED ENCODING PARAMETERS: 



S9 



SUPERPOSE user.data ON 
THE. ENCODED BIT„STREAM 



S10. 



(jnd) 
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re cod i ng_st reani_i ruo v j\ 


No of b ! ts 


Mnsmon i c 


user data start code 


oc 


ke 1 kf 

DS 1 DT 


re_c od i ng_s t r earn. i n f o_ 1 U 


1R 

1 Q 


k<; I kf 
Do 1 Di 


■ t ft 
redjbwj 1 ag 


1 


U 1 mSDT 


if (redJ>w_T lag) 






rtkA kw \ r\Al f*2k¥ftr 
icu^OW^ 1 lid 1 ua lui 


2 


uimsbf 


if (IredJmJ lag) { 






for (i=0; i<number_of_macroblock:++) { 






marker_bit 


3 


bslbf 


nuni_other_bits 


7 


uimsbf 


numjnv.bits 


8 


uimsbf 


num_coef _b i ts 


14 


uimsbf 


} 






} 






next_start_code ( ) 






} 







F I 6.49 



COMBINATION 
OF HISTORY- 
INFORMATION 
ITEMS 


red_bw_f lag 




red_bw_ indicator 


COMBINATION 


1 


0 




COMBINATION 


2 


1 


0 


COMBINATION 


3 


1 


1 


COMBINATION 


4 


1 


2 


COMBINATION 


5 


1 


3 



B3 



EP 1111 932 A2 
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F I G.51 



picture rate e I ements (51-1) 



parameter 


number 
format 


number 
of 
bits 


bit 
offset 
f rom 


bit 
offset 
to 


data 
cate- 

22£Ii 


detai Is 


MPEG standard flag 


Ibit tlag 


i 

1 


n 
u 


n 


«j 


1=>UPEG 1 :0=>MPEG2 


red bwjrlag 


Ibit Tlag 


i 
1 


1 


1 

1 


o 


L-*tf i all ft U 


red bwjndicator 




g 
0 


9 
L 


/ 

n 


Q 
0 


L/cTau 1 X UUVJ 


header present flags 


2b i t flags 


2 


c 
0 


c 
0 


q 
o 


sequence header 
present flag. GOP 
header present flag 


Extension start code flags 


ip it — . 
lb flags 


lb 


7 


LL 




extension start cod* 
exists* i raj id Tias5 
correspond to the 16 
entries in tab It 6,2 of 
the rSTVIEC 13816-2: 
1996 standard in the 
order they are listed. 


nth^r start codes 


3 flags 


3 


23 


25 


3 


userjata.start.code. 

sequence_.error.code, 

secuence_end_code 
















nui 1 -tun La i \ tc 


14b it uimsbf 


14 


26 


39 


2 


includes extension 


vprt 1 ra 1 si ze 


14bit uimsbf 


14 


40 


53 


2 


includes extension 


a^oect ratio information 


4bit uimsbf 


4 


54 


57 


2 




frame rate code 


4b it uimsbf 


4 


58 


61 


2 


ineludet extension correct 
vslu# should be calculated 


b i t rate 


30b i t uimsbf 


30 


62 


91 


2 


includes extension 


vbv_butter_size 


18b it uimsbf 


18 


92 


109 


2 




constrained .parameters flag 


1bit flag 


1 


110 


110 


2 




sequence extension 














prof i 1 e_and„ 1 eve Li nd i cat i on 


8b i t uimsbf 


8 


111 


118 


2 




progress ive_sequence 


1bit flag 


1 


119 


119 


2 




chroma format 


2b i t uimsbf 


2 


120 


121 


2 




low_delay 


Ibit flag 


1 


122 


122 


2 




sequence display extension 














veido_format 


3b i t uimsbf 


3 


123 


125 


2 




colour_description 


Ibit flag 


1 


126 


126 


2 




colour_primar ies 


8b i t uimsbf 


8 


127 


134 


2 




transf er_character i st i cs 


8b i t uimsbf 


8 


135 


142 


2 




matrix__coeff icients 


8b i t uimsbf 


8 


143 


150 


2 




d i sp 1 ay_hor i zonta 1 _s i ze 


14bit uimsbf 


14 


151 


164 


2 




display_vertical_size 


14b i t uimsbf 


14 


165 


178 


2 




group of pictures header 














time_code 


25bit flag 


25 


179 


203 


2 




c 1 osed_gop 


Ibit flag 


1 


204 


204 


2 
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picture rate elements (51-2) 



brokerMinlr 


IDIT Tiag 


i 






9 




picture header ' ~" ** 














tempora preference 


lUbit uimsbt 


1 o 
10 


one 
CUD. 




1 




picturejcodingirype "~ 


obit uimsbt 


3 


Zlo 


Zlo 


1 






Ibbit uimsbf 


16 


-219 


234 


1 


should be calculated if 
not present in bitsfrmi 


ful LpeLforwardjvector ■ / 


ib it flags - 


- 1 


-235 


HOC 

235 


1 


* ** j - ■ ' " '; 


fonward^f.code ~ '!* 


3b i t uimsbf 


: 3 


236 


238 


1 


*' - - -* 


fu!l_pel_backward_vector - v 


1 b it flags 


- 1 


239- 


239 


.]:. 


, - - .. : 


backward_f_:Code — ' ~ - ' 


3b i t uimsbf- 


- 3^ 


240- 


242 


A. 




picture coding extension- 










- ■ 




f orward.hor i zon ta 1 _f _code" v - 


4b it uimsbf 


4:: 


243 ■ 


246 


.1. 




forward_vert icaljf code: 


4b it uimsbf 


4 


.247- 


250 


-1 




backward_horizontaLrcode:~ i 


4b it uimsbf 


.4 ' 


.251/ 


.254 


.1 




backward_vertrcal_f_code. _ . ., 


4b it uimsbf 


4 


255 


258. 


I. 




intra^dc_prec is ion •//•'. 


2b it uimsbf 


'2.'- 


259 


.260 


1 


- - 


picture_stucture 


2b it uimsbf. 


2 : 


261 


.262 


) 




top_f ield_f irst ' 


1 b it flag . 


1 


263 


263 


1 




f rame^p r edjf rame_dc t 


Ibit "'flag 


1 


264 


264 


■1 




concealment_motion_vectors */ 


lb it flag - : 


1 


265 


265 


r 




q scale_type 


Ibit flag 


1 


266 


266 


i 




intra_vlc_format 


Ibit flag 


1 


267 


267 


1 




alternate scan 


1b it flag i: 


1 : 


268 


268 


i 




repeat.f irst_f ield 


1 L * J. ■ X I 

1bit f lag ; 


1 ' 


269 


269 


1 




chroma_420_type 


ibit flag 


1 


270 


270 


1 




p rog ress i ve_f rame 


Ibit tiag ... 


l 


Z7J 


07 1 

fZ.M 


1 




compos i te_id isplay_f lag r :* ■"•>> 


Ibit tiag * 






070 

lie 


] 




v_ax | s.-?*~~ - w - * • - — - * 


id i.t nag. 


1 
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